-- Logs begin at Thu 2021-12-09 14:01:54 UTC, end at Thu 2021-12-09 15:02:41 UTC. -- Dec 09 14:34:39.975451 dv-cinder-819692-8-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Dec 09 14:34:42.765472 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.common.config [-] Logging enabled! Dec 09 14:34:42.766056 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev270 Dec 09 14:34:42.766270 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=108918) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 09 14:34:42.769683 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.common.config [-] Logging enabled! Dec 09 14:34:42.769928 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev270 Dec 09 14:34:42.770243 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=108918) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Dec 09 14:34:42.771184 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 09 14:34:42.771419 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 09 14:34:42.771821 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 09 14:34:42.772065 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 09 14:34:42.772294 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 09 14:34:42.772615 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.773034 dv-cinder-819692-8-iscsi neutron-server[108918]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Dec 09 14:34:42.773350 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.773631 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.773923 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.774217 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.774505 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.774790 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.775076 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.775376 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.775683 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.775944 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.776229 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.776518 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.776802 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] config_source = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.777094 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.777380 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.777661 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] debug = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.777941 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.778364 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.778797 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.779080 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.779367 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.779664 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.779939 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.780214 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.780496 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.780823 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] host = dv-cinder-819692-8-iscsi {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.781100 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.781384 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.781668 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.781950 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.782344 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.782623 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.782907 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.783182 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] log_dir = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.783454 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] log_file = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.783768 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.784058 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.784351 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.784634 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.784860 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.785084 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.785371 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.785654 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.785930 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.786202 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.786478 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.786748 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.787021 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.787288 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.787569 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.787874 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.788158 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.788431 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.788706 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.788981 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.789251 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.789534 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.789805 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.790077 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.790347 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.790627 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.790896 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.791168 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.791467 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.791776 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.792058 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.792347 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.792618 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.792901 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.793172 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.793443 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] use_journal = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.793713 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] use_json = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.793984 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.794253 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.794532 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.794801 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.795072 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.795344 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.795624 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.795916 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:42.796213 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.796509 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.796810 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.797090 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.797396 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.797674 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.797990 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.798271 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.798563 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.798841 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.799134 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.799411 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.799721 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.800000 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.800292 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.800592 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.800885 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.801175 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.801449 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.801721 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.801992 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.802269 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.802561 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.802831 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.803117 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.803404 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.803709 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.804014 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.804298 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.804587 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.804873 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.805146 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.805429 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.805716 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.805991 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.806262 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.806538 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.806830 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.807108 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.807378 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.807686 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.807970 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.808251 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.808525 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.808804 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.809101 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.809379 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.809652 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.809923 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.810200 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.810467 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.810750 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.811028 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.811305 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.811576 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.811885 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.812156 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.812429 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.812699 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.812973 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.813251 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.813575 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.813846 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.814117 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.814387 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.814656 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.814926 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.815197 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.815471 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.815764 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.816032 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.816302 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.816574 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.816844 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.817132 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.817431 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.817707 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.817982 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.818256 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.818530 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.818803 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.819083 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.819358 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.819656 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.819929 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.820232 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.820496 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.820777 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.821057 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.821358 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.821650 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.821924 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.822203 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.822477 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.822750 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.823037 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.823314 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.823631 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.823919 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.824211 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.824502 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.824794 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.825074 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.825380 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.825660 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:42.825876 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 09 14:34:42.826117 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=108918) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Dec 09 14:34:43.252961 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=108918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 14:34:43.253248 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=108918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 14:34:43.253556 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=108918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 09 14:34:43.253892 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.manager [-] Loading core plugin: ml2 Dec 09 14:34:43.582947 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.583216 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.583503 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.584835 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.585113 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.585444 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.631152 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.631437 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.631722 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.645970 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.646259 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.646532 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.675116 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.675389 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.675655 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.712703 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.712982 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:43.713251 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.050562 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.051247 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.051247 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.051391 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.052084 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.150289 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.150591 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.150885 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.151151 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.151420 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.151747 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.152030 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.152291 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.152547 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.152837 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.153097 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.153369 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.153608 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.153863 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.154119 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.154385 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.154639 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.154909 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.155181 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.155423 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.155721 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.155984 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.156267 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.156650 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.157861 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.158041 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.158458 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=108918) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 14:34:44.158700 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=108918) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 14:34:44.158942 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=108918) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 14:34:44.159183 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=108918) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 14:34:44.159423 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=108918) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 14:34:44.159692 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=108918) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 14:34:44.160065 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Dec 09 14:34:44.163240 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Dec 09 14:34:44.167377 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Dec 09 14:34:44.171348 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(400, 449)])]) Dec 09 14:34:44.173068 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Dec 09 14:34:44.173551 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Dec 09 14:34:44.173891 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Dec 09 14:34:44.174280 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Dec 09 14:34:44.177164 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Dec 09 14:34:44.177417 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Dec 09 14:34:44.177777 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Dec 09 14:34:44.183136 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Dec 09 14:34:44.206152 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Dec 09 14:34:44.206609 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.206911 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=108918) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Dec 09 14:34:44.207277 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.208706 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=108918) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Dec 09 14:34:44.208986 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Dec 09 14:34:44.209238 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Dec 09 14:34:44.212578 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.212860 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.278064 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Dec 09 14:34:44.278305 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Dec 09 14:34:44.278542 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Dec 09 14:34:44.278911 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Dec 09 14:34:44.302021 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_db.sqlalchemy.engines [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108918) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 09 14:34:44.738208 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Initializing driver for type 'gre' Dec 09 14:34:44.738734 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] gre ID ranges: [(1, 1000)] Dec 09 14:34:44.792967 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Initializing driver for type 'local' Dec 09 14:34:44.793431 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Initializing driver for type 'vlan' Dec 09 14:34:44.809705 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] VlanTypeDriver initialization complete Dec 09 14:34:44.810062 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Initializing driver for type 'vxlan' Dec 09 14:34:44.810628 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] vxlan ID ranges: [(1, 1000)] Dec 09 14:34:44.862941 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Initializing extension driver 'port_security' Dec 09 14:34:44.863286 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.extensions.port_security [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] PortSecurityExtensionDriver initialization complete Dec 09 14:34:44.863647 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Initializing mechanism driver 'openvswitch' Dec 09 14:34:44.863975 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Initializing mechanism driver 'hyperv' Dec 09 14:34:44.871194 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.plugins.ml2.plugin [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=108918) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:34:44.872069 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > port after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.872447 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > port after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.872800 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > port after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.873340 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=108918) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 09 14:34:44.873778 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > subnet after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.874133 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > subnet after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.874485 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > subnet after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.874893 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=108918) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 09 14:34:44.875301 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > network after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.875672 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > network after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.876018 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > network after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.876419 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=108918) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 09 14:34:44.876825 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > security_group after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.877180 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > security_group after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.877522 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > security_group after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.877924 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=108918) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 09 14:34:44.878339 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.878687 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.879027 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.879424 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=108918) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 09 14:34:44.879851 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > address_group after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.880209 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > address_group after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.880550 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > address_group after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.880949 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=108918) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Dec 09 14:34:44.881336 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] ML2 OVO RPC backend initialized. {{(pid=108918) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Dec 09 14:34:44.882038 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router_interface after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.882393 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router_interface after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.882803 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > network before_response 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.883152 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > networks before_response 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.883500 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > port before_response 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.883869 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > ports before_response 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.884211 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > subnet before_response 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.884567 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > subnets before_response 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.884899 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > network after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.885238 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > network after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.885573 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > network after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.885907 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > port after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.886242 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > port after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.886578 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > port after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.886913 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > subnet after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.887248 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > subnet after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.887594 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > subnet after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.888180 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.plugin [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Modular L2 Plugin initialization complete Dec 09 14:34:44.888512 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading services supported by the core plugin {{(pid=108918) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Dec 09 14:34:44.888858 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.plugins.ml2.managers [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Got port-security extension from driver 'port_security' Dec 09 14:34:44.889308 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.extensions.vlantransparent [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Disabled vlantransparent extension. Dec 09 14:34:44.889806 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=108918) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Dec 09 14:34:44.890119 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading Plugin: router Dec 09 14:34:44.926145 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router_interface before_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.926532 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router after_create 55549900 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.926902 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router before_create 55549900 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.927272 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router_interface before_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.927654 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router_interface after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.928028 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router after_delete 55549900 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.928387 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > floatingip after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.928866 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > floatingip after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.929231 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router after_create 55549900 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.929577 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router after_update 55549900 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.929931 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router after_update 55549900 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.930270 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.930634 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router after_update 55549900 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.931050 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router precommit_update 55549900 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.931424 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: port after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.931796 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: port after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.932141 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: subnet after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.932480 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.932828 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > port precommit_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.933175 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router precommit_create 55549900 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.933519 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: port before_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.933846 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router precommit_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.934205 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router after_update 55549900 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.934547 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router precommit_delete 55549900 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.934895 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router precommit_create 55549900 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.935256 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router_interface after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.935615 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router precommit_update 55549900 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.935997 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > agent after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.936339 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > agent after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.936685 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > network after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.937548 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Tracking information for resource: router configured {{(pid=108918) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 14:34:44.937884 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Tracking information for resource: floatingip configured {{(pid=108918) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Dec 09 14:34:44.942924 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.db.l3_agentschedulers_db [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Dec 09 14:34:44.943534 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: port after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.943921 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: port after_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.944277 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: port after_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.944629 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: port after_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.945422 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router before_create 55550100 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.945787 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router precommit_delete 55550100 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.946153 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router precommit_create 55550100 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.946512 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > router precommit_update 55550100 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.951425 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.services.provider_configuration [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Service providers = [] {{(pid=108918) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Dec 09 14:34:44.951824 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.db.servicetype_db [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=108918) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Dec 09 14:34:44.954839 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.services.service_base [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=108918) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 09 14:34:44.955186 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.services.service_base [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=108918) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 09 14:34:44.955532 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.services.service_base [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=108918) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 09 14:34:44.956456 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.services.service_base [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=108918) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Dec 09 14:34:44.956823 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.services.service_base [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Default provider is not specified for service type L3_ROUTER_NAT Dec 09 14:34:44.957192 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=108918) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 14:34:44.957514 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Dec 09 14:34:44.968298 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Successfully loaded METERING plugin. Description: METERING {{(pid=108918) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 14:34:44.968572 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading Plugin: auto_allocate Dec 09 14:34:44.974472 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: network precommit_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.974843 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: network precommit_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.975365 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=108918) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 14:34:44.975713 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading Plugin: tag Dec 09 14:34:44.982552 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=108918) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 14:34:44.982885 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading Plugin: timestamp Dec 09 14:34:44.986787 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=108918) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 14:34:44.987121 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading Plugin: network_ip_availability Dec 09 14:34:44.992648 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.993023 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.993381 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:44.994100 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=108918) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 14:34:44.994417 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading Plugin: flavors Dec 09 14:34:44.999925 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=108918) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 14:34:45.000263 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading Plugin: revisions Dec 09 14:34:45.004652 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=108918) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Dec 09 14:34:45.005049 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_concurrency.lockutils [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.751s {{(pid=108918) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 09 14:34:45.005794 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=108918) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Dec 09 14:34:45.006140 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Initializing extension manager. Dec 09 14:34:45.006661 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: __init__.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.007003 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: __pycache__ {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.007338 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.007693 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: address_group.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.008468 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.009038 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: address-group Dec 09 14:34:45.009364 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: address_scope.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.010088 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.010602 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: address-scope Dec 09 14:34:45.010927 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: admin_state_down_before_update.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.011880 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.012391 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: router-admin-state-down-before-update Dec 09 14:34:45.012715 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: agent.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.013416 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.013922 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: agent Dec 09 14:34:45.014244 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: agent_resources_synced.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.015164 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.015691 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: agent-resources-synced Dec 09 14:34:45.016015 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: allowedaddresspairs.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.017843 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.018368 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: allowed-address-pairs Dec 09 14:34:45.018692 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: auto_allocated_topology.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.019812 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.020328 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: auto-allocated-topology Dec 09 14:34:45.020654 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: availability_zone.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.021351 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.021859 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: availability_zone Dec 09 14:34:45.022180 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: availability_zone_filter.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.023100 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.023621 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: availability_zone_filter Dec 09 14:34:45.023966 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: data_plane_status.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.024889 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.025391 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension data-plane-status not supported by any of loaded plugins Dec 09 14:34:45.025712 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: default_subnetpools.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.026651 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.027168 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: default-subnetpools Dec 09 14:34:45.027496 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: dhcpagentscheduler.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.028393 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.028896 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: dhcp_agent_scheduler Dec 09 14:34:45.029217 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: dns.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.030156 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.030659 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension dns-integration not supported by any of loaded plugins Dec 09 14:34:45.030963 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: dns_domain_ports.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.031926 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.032491 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension dns-domain-ports not supported by any of loaded plugins Dec 09 14:34:45.032809 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.033732 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.034238 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Dec 09 14:34:45.034558 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: dvr.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.035229 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.035776 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: dvr Dec 09 14:34:45.036099 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: ecmp_routes.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.037028 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.037524 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension ecmp_routes not supported by any of loaded plugins Dec 09 14:34:45.037860 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: empty_string_filtering.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.038774 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.039281 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: empty-string-filtering Dec 09 14:34:45.039619 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.040550 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.041055 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Dec 09 14:34:45.041376 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.042301 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.042804 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Dec 09 14:34:45.043124 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: external_net.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.044078 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.044579 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: external-net Dec 09 14:34:45.044900 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: extra_dhcp_opt.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.045809 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.046310 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: extra_dhcp_opt Dec 09 14:34:45.046636 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: extraroute.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.047553 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.048233 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: extraroute Dec 09 14:34:45.048558 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: extraroute_atomic.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.051286 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.051869 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: extraroute-atomic Dec 09 14:34:45.052183 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: filter_validation.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.052872 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.053388 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: filter-validation Dec 09 14:34:45.053720 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: fip_pf_description.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.054642 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.055152 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Dec 09 14:34:45.055481 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: fip_port_details.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.056429 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.056940 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: fip-port-details Dec 09 14:34:45.057262 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: flavors.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.058534 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.059049 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: flavors Dec 09 14:34:45.059383 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.061104 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.061625 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Dec 09 14:34:45.061957 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: floatingip_pools.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.062664 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.063173 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: floatingip-pools Dec 09 14:34:45.063554 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: ip_allocation.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.064520 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.065030 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension ip_allocation not supported by any of loaded plugins Dec 09 14:34:45.065357 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: ip_substring_port_filtering.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.066280 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.066797 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: ip-substring-filtering Dec 09 14:34:45.067124 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: l2_adjacency.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.068086 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.068596 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension l2_adjacency not supported by any of loaded plugins Dec 09 14:34:45.068918 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: l3.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.069934 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.070454 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: router Dec 09 14:34:45.070783 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: l3_conntrack_helper.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.073125 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.073658 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension l3-conntrack-helper not supported by any of loaded plugins Dec 09 14:34:45.073988 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: l3_ext_gw_mode.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.074942 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.075459 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: ext-gw-mode Dec 09 14:34:45.075821 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: l3_ext_ha_mode.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.076753 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.077269 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: l3-ha Dec 09 14:34:45.077602 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: l3_flavors.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.078537 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.079083 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: l3-flavors Dec 09 14:34:45.079408 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.080381 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.080897 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: l3-port-ip-change-not-allowed Dec 09 14:34:45.081218 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: l3agentscheduler.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.082269 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.082783 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: l3_agent_scheduler Dec 09 14:34:45.083110 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: local_ip.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.084939 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.085468 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension local_ip not supported by any of loaded plugins Dec 09 14:34:45.085803 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: logging.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.087288 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.087839 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension logging not supported by any of loaded plugins Dec 09 14:34:45.088170 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: metering.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.089057 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.089633 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: metering Dec 09 14:34:45.089961 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.091062 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.091578 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: metering_source_and_destination_fields Dec 09 14:34:45.091934 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: multiprovidernet.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.092878 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.093387 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: multi-provider Dec 09 14:34:45.093718 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: netmtu.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.094688 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.095206 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: net-mtu Dec 09 14:34:45.095527 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: netmtu_writable.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.096492 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.097000 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: net-mtu-writable Dec 09 14:34:45.097324 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: network_availability_zone.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.098005 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.098512 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: network_availability_zone Dec 09 14:34:45.098829 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: network_ip_availability.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.099964 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.100479 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: network-ip-availability Dec 09 14:34:45.100803 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: network_segment_range.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.101577 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.102080 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension network-segment-range not supported by any of loaded plugins Dec 09 14:34:45.102398 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: pagination.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.103388 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.103752 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: pagination Dec 09 14:34:45.104073 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: port_device_profile.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.105004 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.105513 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: port-device-profile Dec 09 14:34:45.105835 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: port_mac_address_regenerate.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.106758 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.107263 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: port-mac-address-regenerate Dec 09 14:34:45.107590 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: port_numa_affinity_policy.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.108536 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.109042 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: port-numa-affinity-policy Dec 09 14:34:45.109369 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: port_resource_request.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.110424 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.110810 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension port-resource-request not supported by any of loaded plugins Dec 09 14:34:45.111128 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: port_resource_request_groups.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.112145 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.112652 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension port-resource-request-groups not supported by any of loaded plugins Dec 09 14:34:45.112976 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: portbindings.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.113907 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.114417 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: binding Dec 09 14:34:45.114738 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: portbindings_extended.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.116052 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.116569 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: binding-extended Dec 09 14:34:45.116900 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: portsecurity.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.117845 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.118333 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: port-security Dec 09 14:34:45.118655 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: project_id.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.119667 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.120329 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: project-id Dec 09 14:34:45.120654 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: providernet.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.121589 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.122134 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: provider Dec 09 14:34:45.122414 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: qos.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.126062 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.126599 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension qos not supported by any of loaded plugins Dec 09 14:34:45.126933 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: qos_bw_limit_direction.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.128246 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.128764 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Dec 09 14:34:45.129095 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.130030 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.130544 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Dec 09 14:34:45.130872 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: qos_default.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.131824 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.132334 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension qos-default not supported by any of loaded plugins Dec 09 14:34:45.132661 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: qos_fip.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.133327 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.133831 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension qos-fip not supported by any of loaded plugins Dec 09 14:34:45.134154 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: qos_fip_network_policy.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.135169 dv-cinder-819692-8-iscsi neutron-server[108918]: WARNING neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension file qos_fip_network_policy.py wasn't loaded due to cannot import name 'qos_fip_network_policy' from 'neutron_lib.api.definitions' (/usr/local/lib/python3.8/dist-packages/neutron_lib/api/definitions/__init__.py) Dec 09 14:34:45.135501 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: qos_gateway_ip.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.136454 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.136966 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension qos-gateway-ip not supported by any of loaded plugins Dec 09 14:34:45.137292 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: qos_port_network_policy.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.138225 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.138736 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension qos-port-network-policy not supported by any of loaded plugins Dec 09 14:34:45.139059 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.140249 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.140762 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension qos-pps-minimum not supported by any of loaded plugins Dec 09 14:34:45.141089 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: qos_pps_rule.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.142301 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.142820 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension qos-pps not supported by any of loaded plugins Dec 09 14:34:45.143144 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: qos_rule_type_details.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.144103 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.144617 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension qos-rule-type-details not supported by any of loaded plugins Dec 09 14:34:45.144941 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: qos_rules_alias.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.145987 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.146502 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension qos-rules-alias not supported by any of loaded plugins Dec 09 14:34:45.146829 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: quota_check_limit.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.147792 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.148309 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: quota-check-limit Dec 09 14:34:45.148638 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: quotasv2.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.149590 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.149915 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: quotas Dec 09 14:34:45.150235 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: quotasv2_detail.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.153455 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.153796 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: quota_details Dec 09 14:34:45.154133 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: rbac.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.155196 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.155762 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: rbac-policies Dec 09 14:34:45.156096 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: rbac_address_group.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.157033 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.157616 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: rbac-address-group Dec 09 14:34:45.157938 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: rbac_address_scope.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.158884 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.159397 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: rbac-address-scope Dec 09 14:34:45.159751 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: rbac_security_groups.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.160679 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.161197 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: rbac-security-groups Dec 09 14:34:45.161522 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: rbac_subnetpool.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.162447 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.162959 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: rbac-subnetpool Dec 09 14:34:45.163283 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: revisionifmatch.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.164248 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.164762 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: revision-if-match Dec 09 14:34:45.165087 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: revisions.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.166210 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.166719 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: standard-attr-revisions Dec 09 14:34:45.167039 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: router_availability_zone.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.167753 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.168260 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: router_availability_zone Dec 09 14:34:45.168583 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: routerservicetype.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.169503 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.170008 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension router-service-type not supported by any of loaded plugins Dec 09 14:34:45.170329 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.171330 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.171869 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: security-groups-normalized-cidr Dec 09 14:34:45.172190 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: security_groups_port_filtering.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.173143 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.173653 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: port-security-groups-filtering Dec 09 14:34:45.173974 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: security_groups_remote_address_group.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.174901 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.175410 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: security-groups-remote-address-group Dec 09 14:34:45.175771 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: security_groups_shared_filtering.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.176704 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.177210 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: security-groups-shared-filtering Dec 09 14:34:45.177539 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.178120 dv-cinder-819692-8-iscsi neutron-server[108918]: WARNING neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Dec 09 14:34:45.178445 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: securitygroup.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.188444 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.188978 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: security-group Dec 09 14:34:45.189314 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: segment.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.190116 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.190624 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension segment not supported by any of loaded plugins Dec 09 14:34:45.190947 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.191953 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.192463 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Dec 09 14:34:45.192793 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: servicetype.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.193914 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.194433 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: service-type Dec 09 14:34:45.194759 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: sorting.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.195786 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.196119 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: sorting Dec 09 14:34:45.196439 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: standard_attr_segment.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.197365 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.197877 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension standard-attr-segment not supported by any of loaded plugins Dec 09 14:34:45.198198 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: standardattrdescription.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.198854 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.199361 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: standard-attr-description Dec 09 14:34:45.199717 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: stateful_security_group.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.200656 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.201190 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: stateful-security-group Dec 09 14:34:45.201516 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: stdattrs_common.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.202103 dv-cinder-819692-8-iscsi neutron-server[108918]: WARNING neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Dec 09 14:34:45.202424 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.203354 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.203894 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Dec 09 14:34:45.204244 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: subnet_onboard.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.205329 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.205852 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: subnet_onboard Dec 09 14:34:45.206176 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: subnet_segmentid_writable.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.207103 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.207758 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Dec 09 14:34:45.207974 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: subnet_service_types.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.208903 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.209419 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: subnet-service-types Dec 09 14:34:45.209743 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: subnetallocation.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.210847 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.211362 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: subnet_allocation Dec 09 14:34:45.211720 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.212396 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.212902 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: subnetpool-prefix-ops Dec 09 14:34:45.213241 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.214199 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.214710 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Dec 09 14:34:45.215032 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: tagging.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.216116 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.216633 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: standard-attr-tag Dec 09 14:34:45.216965 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: timestamp.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.218198 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.218762 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loaded extension: standard-attr-timestamp Dec 09 14:34:45.219041 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: trunk.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.220150 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.220659 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension trunk not supported by any of loaded plugins Dec 09 14:34:45.220986 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: trunk_details.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.221906 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.222415 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension trunk-details not supported by any of loaded plugins Dec 09 14:34:45.222737 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: uplink_status_propagation.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.223692 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.224192 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension uplink-status-propagation not supported by any of loaded plugins Dec 09 14:34:45.224511 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Loading extension file: vlantransparent.py {{(pid=108918) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Dec 09 14:34:45.225178 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=108918) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Dec 09 14:34:45.225680 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extension vlan-transparent not supported by any of loaded plugins Dec 09 14:34:45.228279 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:network Dec 09 14:34:45.228804 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:subnet Dec 09 14:34:45.229206 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:subnetpool Dec 09 14:34:45.229612 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:port Dec 09 14:34:45.230845 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.v2.resource_helper [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108918) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 14:34:45.231277 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.v2.resource_helper [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Service FLAVORS assigned prefix: {{(pid=108918) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 14:34:45.231916 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.v2.resource_helper [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108918) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 14:34:45.232340 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.v2.resource_helper [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108918) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 14:34:45.232674 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:router Dec 09 14:34:45.233115 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:floatingip Dec 09 14:34:45.233618 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.v2.resource_helper [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Service METERING assigned prefix: /metering {{(pid=108918) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 14:34:45.235143 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:45.235539 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:45.235908 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108918) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:34:45.236945 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of CountableResource for resource:rbac_policy Dec 09 14:34:45.237385 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:security_group Dec 09 14:34:45.237816 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:security_group_rule Dec 09 14:34:45.238440 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.v2.resource_helper [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Service CORE assigned prefix: {{(pid=108918) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 14:34:45.238768 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:subnetpool Dec 09 14:34:45.239111 dv-cinder-819692-8-iscsi neutron-server[108918]: WARNING neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] subnetpool is already registered Dec 09 14:34:45.239544 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.v2.resource_helper [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Service CORE assigned prefix: {{(pid=108918) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 14:34:45.239897 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:subnetpool Dec 09 14:34:45.240225 dv-cinder-819692-8-iscsi neutron-server[108918]: WARNING neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] subnetpool is already registered Dec 09 14:34:45.242467 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.v2.resource_helper [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108918) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 14:34:45.242900 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.v2.resource_helper [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Service FLAVORS assigned prefix: {{(pid=108918) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 14:34:45.243488 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.v2.resource_helper [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108918) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 14:34:45.243948 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.v2.resource_helper [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108918) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 14:34:45.244283 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:router Dec 09 14:34:45.244625 dv-cinder-819692-8-iscsi neutron-server[108918]: WARNING neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] router is already registered Dec 09 14:34:45.245383 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:floatingip Dec 09 14:34:45.245716 dv-cinder-819692-8-iscsi neutron-server[108918]: WARNING neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] floatingip is already registered Dec 09 14:34:45.246188 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.v2.resource_helper [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Service METERING assigned prefix: /metering {{(pid=108918) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 14:34:45.246848 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of CountableResource for resource:rbac_policy Dec 09 14:34:45.247177 dv-cinder-819692-8-iscsi neutron-server[108918]: WARNING neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] rbac_policy is already registered Dec 09 14:34:45.247592 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:security_group Dec 09 14:34:45.247947 dv-cinder-819692-8-iscsi neutron-server[108918]: WARNING neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] security_group is already registered Dec 09 14:34:45.248348 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:security_group_rule Dec 09 14:34:45.248683 dv-cinder-819692-8-iscsi neutron-server[108918]: WARNING neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] security_group_rule is already registered Dec 09 14:34:45.249307 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.v2.resource_helper [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Service CORE assigned prefix: {{(pid=108918) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 14:34:45.249635 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:subnetpool Dec 09 14:34:45.249967 dv-cinder-819692-8-iscsi neutron-server[108918]: WARNING neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] subnetpool is already registered Dec 09 14:34:45.250385 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.v2.resource_helper [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Service CORE assigned prefix: {{(pid=108918) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Dec 09 14:34:45.250711 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Creating instance of TrackedResource for resource:subnetpool Dec 09 14:34:45.251094 dv-cinder-819692-8-iscsi neutron-server[108918]: WARNING neutron.quota.resource_registry [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] subnetpool is already registered Dec 09 14:34:45.251554 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: extensions {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.253051 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: address-groups {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.254551 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: address-scopes {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.255896 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: agents {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.257087 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: auto-allocated-topology {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.258360 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: availability_zones {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.259634 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: dhcp-networks {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.261163 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: dhcp-agents {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.262620 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: routers {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.264906 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: flavors {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.266085 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: service_profiles {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.267354 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: next_providers {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.268844 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: service_profiles {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.271349 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: floatingip-pools {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.272624 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: routers {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.274764 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: floatingips {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.276087 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: l3-routers {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.277484 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: l3-agents {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.278919 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: metering-labels {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.280327 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: metering-label-rules {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.281618 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: network-ip-availabilities {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.282938 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: bindings {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.284660 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: quotas {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.286238 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: quotas {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.287811 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: rbac-policies {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.289115 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: security-groups {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.290338 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: security-group-rules {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.291594 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: service-providers {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.292838 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: subnetpools {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.294282 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: subnetpools {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.295768 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: tags {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.297478 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: tags {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.299391 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: tags {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.301231 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: tags {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.303070 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: tags {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.304969 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: tags {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.306673 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: tags {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.308637 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: tags {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.310442 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: tags {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.312321 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron.api.extensions [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Extended resource: tags {{(pid=108918) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Dec 09 14:34:45.318408 dv-cinder-819692-8-iscsi neutron-server[108918]: WARNING keystonemiddleware.auth_token [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 09 14:34:45.323194 dv-cinder-819692-8-iscsi neutron-server[108918]: WARNING keystonemiddleware.auth_token [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 09 14:34:45.332143 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_concurrency.lockutils [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Acquired lock "singleton_lock" {{(pid=108918) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 09 14:34:45.332608 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_concurrency.lockutils [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Releasing lock "singleton_lock" {{(pid=108918) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 09 14:34:45.333276 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO oslo_service.service [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Starting 2 workers Dec 09 14:34:45.338176 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Started child 109061 {{(pid=108918) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 09 14:34:45.342663 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Started child 109062 {{(pid=108918) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 09 14:34:45.343841 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:34:45.344555 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO neutron.service [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Neutron service started, listening on 0.0.0.0:9696 Dec 09 14:34:45.344906 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Publish callbacks [] for process, before_spawn {{(pid=108918) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:34:45.345535 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [-] (109061) wsgi starting up on http://0.0.0.0:9696 Dec 09 14:34:45.347368 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO oslo_service.service [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Starting 1 workers Dec 09 14:34:45.347503 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:34:45.348789 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [-] (109062) wsgi starting up on http://0.0.0.0:9696 Dec 09 14:34:45.352676 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Started child 109063 {{(pid=108918) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 09 14:34:45.353219 dv-cinder-819692-8-iscsi neutron-server[108918]: INFO oslo_service.service [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Starting 1 workers Dec 09 14:34:45.356541 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.service [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] calling RpcWorker wait() {{(pid=109063) _wait /opt/stack/neutron/neutron/service.py:128}} Dec 09 14:34:45.357127 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.service [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] returning from RpcWorker wait() {{(pid=109063) _wait /opt/stack/neutron/neutron/service.py:135}} Dec 09 14:34:45.357773 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Started child 109064 {{(pid=108918) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Dec 09 14:34:45.358538 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG neutron_lib.callbacks.manager [None req-5f12b3b6-9443-4256-84cc-35833a84998e None None] Publish callbacks [] for process, after_spawn {{(pid=108918) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:34:45.358665 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:34:45.359129 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:34:45.360440 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=108918) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 09 14:34:45.361281 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 09 14:34:45.361281 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 09 14:34:45.361281 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 09 14:34:45.361873 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 09 14:34:45.362025 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 09 14:34:45.362535 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.362823 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.363150 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.363431 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.363582 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:34:45.364447 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.364447 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.364613 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.364760 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.365234 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.365435 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.365603 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.365925 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.366190 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.366452 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.366744 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.367016 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.367250 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.367512 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.367708 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.367971 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] config_source = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.368235 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.368493 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.368698 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] debug = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.368934 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.369590 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.369782 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.370391 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.370595 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.370852 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.371093 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.371372 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.371540 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.372010 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.372010 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.372283 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.372473 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.372694 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.372930 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.373176 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.373425 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.373706 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.374074 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] host = dv-cinder-819692-8-iscsi {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.374492 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.374665 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.374916 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.375161 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.375426 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.375635 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.375995 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.376163 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.376385 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.376658 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.376861 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.377111 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.377347 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_dir = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.377621 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_file = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.377774 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_options = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.377912 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.378207 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.378440 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.378837 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.379005 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.379124 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.379410 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.379745 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.379892 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.380040 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.380304 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.380513 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.380684 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.380894 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.381187 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.381407 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.381635 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.381825 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.382048 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.382271 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.382534 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.382698 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.382941 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.383187 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.383387 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.383654 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.384432 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.384432 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.384432 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.384894 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.384894 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.385158 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.385158 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.385433 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.385689 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.385890 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.386088 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.386330 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.386652 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.386804 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.387044 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.387273 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.387655 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.387836 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.387960 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.388185 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] use_journal = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.388422 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] use_json = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.388628 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.388840 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.389068 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.389289 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.389519 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.389759 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.390016 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.390219 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.390602 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.390874 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.391193 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.391463 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.391747 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.391992 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.393183 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.393532 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.393896 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.394105 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.394468 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.394787 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.394922 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.395159 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.395441 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.395807 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.396016 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.396289 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.396725 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.397123 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.397544 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.397932 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.398350 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.398829 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.399247 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.399666 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.400056 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.400630 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.400808 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:34:45.401783 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.402169 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.402461 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.402724 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.39/identity {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.402998 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.403246 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.403500 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.403891 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.404129 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.404346 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.404759 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.404971 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.405205 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.405421 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.405673 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.406087 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.406637 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.406927 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.408202 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.408408 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.408654 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.408839 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.409065 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.409278 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.409546 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.409779 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.409967 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.410266 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.410533 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.410743 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.410967 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.411191 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.411829 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.412001 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.419420 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.419420 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.419420 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.419420 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.419420 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.419420 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.419420 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.419420 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.419420 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.420049 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.420049 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.420049 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.420049 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.420049 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.420049 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.420049 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.420049 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.420634 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.420939 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.421226 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.421498 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.421914 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.422360 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.424428 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.425280 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.425977 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.426984 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.427504 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.428601 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.429066 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.430060 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.430337 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.430625 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.430865 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.431138 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.431375 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.431665 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.431900 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.432133 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.432354 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.432617 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.432873 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.433111 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.433342 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.433584 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.433858 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.434104 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.434364 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.434590 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.434830 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.435094 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.435357 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.435598 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.436927 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.437675 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.437948 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.438245 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.440204 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.440516 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.440744 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.441051 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.441370 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.441652 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.441917 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.442160 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.442421 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.442669 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.442927 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.443195 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.443434 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.443843 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.444142 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.444367 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.444620 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.444875 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.445128 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.445497 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.445774 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.446004 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.446223 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.446554 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.446803 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.447474 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.447809 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.448066 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.448308 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.448564 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.448859 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.39/identity {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.449085 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.449333 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.449569 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.449819 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.450061 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.450281 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.450807 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.450807 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.450974 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.451196 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.451413 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.451674 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.452601 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.452601 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.452761 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.453116 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.453384 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.453608 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.453860 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.454156 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.454389 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.454614 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.454833 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.455092 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.455317 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.455629 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.455880 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.456101 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.456333 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.456588 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.457443 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.457694 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.457962 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.458187 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.458713 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.458944 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.459712 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.459712 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.459712 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.459993 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.460172 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.460428 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.460678 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.461014 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.461265 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.461498 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.461765 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.461987 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.462211 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.462451 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.462672 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.462890 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.463128 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.463347 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.463591 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.463852 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.464105 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.464327 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.464558 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.464769 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.465001 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.465220 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.465513 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.465754 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.465984 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.466238 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.466456 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.466669 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.466902 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.467113 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.467326 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.467547 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.467790 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.468002 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.468250 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.468473 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.468660 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.468943 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.469106 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.469424 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.469685 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.470115 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.470334 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.470561 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.470776 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.471037 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.471296 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.471517 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.471733 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.471954 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.472173 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.472384 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.472612 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.472843 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.473448 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.473709 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.473931 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.474435 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.474754 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.475237 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.475463 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.475772 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.476007 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.476259 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.476559 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.476900 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.477490 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.478039 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.478284 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.478537 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.478764 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.479251 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.479575 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.479902 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.480157 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.480395 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.480666 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.480948 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:400:449'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.481211 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.481426 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.481728 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.482066 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.482352 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.482613 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.482859 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.483105 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.483332 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.483567 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.483827 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.484066 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.484291 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.484530 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.484762 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.484989 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.485275 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.485529 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.485757 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.486013 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.486266 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.486506 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.486737 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.486895 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 09 14:34:45.487648 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=108918) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Dec 09 14:34:45.487648 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 09 14:34:45.487869 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 09 14:34:45.487954 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 09 14:34:45.488126 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 09 14:34:45.488282 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 09 14:34:45.488601 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.489044 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.491637 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.491637 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.491637 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.491637 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.491637 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.491637 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.491637 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.491637 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.492235 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.492235 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.492235 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.492451 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:34:45.492543 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.492543 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.492543 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.492543 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.492543 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.492543 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.492543 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] config_source = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.492543 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.493065 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.493065 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] debug = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.493065 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.493065 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.493065 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.493065 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.493502 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.493502 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.493502 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.493502 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.493767 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.493767 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.493913 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.494045 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.494202 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.494360 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.494521 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.494679 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.494837 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.495331 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.495491 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] host = dv-cinder-819692-8-iscsi {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.495677 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.495836 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.495997 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.496156 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.496314 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.496472 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.496632 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.496791 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.496951 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.497111 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.497270 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.497428 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.497587 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_dir = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.497747 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_file = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.497906 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_options = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.498065 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.498224 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.498382 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.498572 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.498736 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.498899 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.499060 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.499219 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.499379 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.499538 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.499719 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.499880 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.500041 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.500198 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.500355 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.500513 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.500673 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.500868 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.501030 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.501190 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.501349 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.501509 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.501666 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.501825 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.501984 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.502143 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.502300 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.502459 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.502624 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.502778 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.502942 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.503098 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.503423 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.503778 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.504108 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.504431 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.504756 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.505100 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.505428 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.506291 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.506526 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.506753 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.506918 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.507072 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.507234 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.507392 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] use_journal = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.507551 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] use_json = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.507731 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.507884 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.508046 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.508262 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.508356 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.508864 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.509025 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.509186 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 09 14:34:45.509369 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.509532 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.509704 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.509865 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.510028 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.510188 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.510348 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.510508 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.510669 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.510828 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.511035 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.511175 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.511330 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.511488 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.511856 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.512050 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.512229 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.512408 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.512587 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.512762 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.512934 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.513104 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.513282 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.513450 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.513613 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.513776 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.513940 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.514112 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.514276 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.514453 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.514615 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.514782 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.39/identity {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.514942 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.515102 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.515265 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.515441 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.515623 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.515794 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.515957 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.516119 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.516280 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.516531 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.516700 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.516859 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.517020 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.517182 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.517343 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.517504 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.517664 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.517836 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.518092 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.518257 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.518418 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.518605 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.518765 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.518927 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.519085 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.519257 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.519421 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.519581 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.519769 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.519929 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.520091 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.520252 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.520414 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.520574 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.520736 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.520894 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.521076 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.521243 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.521402 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.521561 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.521722 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.521882 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.522042 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.522202 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.522361 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.522519 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.522679 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.522840 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.523005 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.523164 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.523328 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.523470 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.523651 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.523818 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.523989 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.524134 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.524292 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.524451 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.524610 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.524786 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.524963 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.525126 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.525290 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.525450 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.525609 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.525769 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.525928 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.526088 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.526247 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.526407 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.526566 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.526725 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.526886 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.527046 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.527206 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.527365 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.527525 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.527703 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.527861 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.528048 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.528281 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.528526 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.528720 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.529603 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.529603 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.529755 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.529837 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.530050 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.530117 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.530292 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.530442 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.530620 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.530774 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.530935 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.531096 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.531256 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.531417 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.531576 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.531954 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.531954 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.532134 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.532235 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.532409 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.532570 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.532730 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.532888 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.533071 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.533231 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.533607 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.533607 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.533762 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.533827 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.533976 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.534133 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.534292 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.534455 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.534616 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.534778 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.39/identity {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.534941 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.535101 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.535260 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.535418 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.535579 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.535759 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.535920 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.536077 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.536236 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.536445 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.536549 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.536678 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.536840 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.536998 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.537157 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.537316 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.537475 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.537635 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.537794 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.537955 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.538174 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.538298 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.538420 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.538576 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.538724 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.538887 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.539047 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.539197 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.539356 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.539515 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.539697 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.539850 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.540011 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.540220 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.540375 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.540494 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.540654 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.540814 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.540982 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.541143 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.541365 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.541504 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.541631 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.541778 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.541936 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.542095 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.542254 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.543330 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.543330 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.543330 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.543330 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.543330 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.543330 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.543330 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.544098 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.544098 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.544098 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.544098 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.544098 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.544650 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.544650 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.544650 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.544982 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.544982 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.544982 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.545293 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.545293 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.545508 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.545626 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.545748 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.545883 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.546043 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.546201 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.546360 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.546559 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.546686 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.546811 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.546967 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.547125 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.547284 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.547452 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.547628 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.547838 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.547997 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.548156 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.548358 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.548485 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.548619 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.548778 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.548937 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.549095 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.549255 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.549422 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.549581 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.549741 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.549900 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.550057 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.550217 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.550384 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.550546 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.550708 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.550874 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.551033 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.551192 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.551351 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.551526 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.551710 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.551876 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.552038 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.552198 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.552357 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.552518 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.552685 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.552852 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.553017 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.553177 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.553347 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.553513 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:400:449'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.553681 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.553842 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.554009 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.554181 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.554340 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.554499 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.554657 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.554821 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.554981 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.555140 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.555299 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.555457 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.555626 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.555794 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.555953 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.556115 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.556273 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.556432 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.556592 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.556751 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.556909 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.557067 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.557227 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 09 14:34:45.557388 dv-cinder-819692-8-iscsi neutron-server[108918]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108918) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 09 14:34:45.652860 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 49940) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:34:45.666294 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [-] 10.222.0.39 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0100746 Dec 09 14:34:57.029365 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4322855-75cc-415f-ab12-b1905a15546f None None] get_active_networks_info from dv-cinder-819692-8-iscsi {{(pid=109063) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Dec 09 14:34:57.086822 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f4322855-75cc-415f-ab12-b1905a15546f None None] No non-hosted networks {{(pid=109063) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Dec 09 14:34:57.102405 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-9451ee71-e6a9-466e-8459-0f3241aae4a6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1627840'] for agent, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:34:59.174114 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-94305eeb-0c71-40e6-bd56-41c2079f2028 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1627840'] for agent, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:34:59.215005 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3ae05360-49d9-4e40-8932-dc32c280a932 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:00.395943 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1627840'] for agent, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:01.810740 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1627840'] for agent, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:02.602256 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1627840'] for agent, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:02.603168 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:02.604016 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:02.604567 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:02.605154 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:02.605580 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:02.606038 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:02.606500 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:02.606953 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:02.607372 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:02.607832 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:02.608262 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:02.608684 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:02.609111 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:02.609632 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-819692-8-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:35:02.622038 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-819692-8-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:35:03.086556 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 50030) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:35:03.621678 dv-cinder-819692-8-iscsi neutron-server[109061]: WARNING oslo_policy.policy [None req-aee53451-d952-419a-9cc1-206e860cf90f admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 14:35:03.622344 dv-cinder-819692-8-iscsi neutron-server[109061]: WARNING oslo_policy.policy [None req-aee53451-d952-419a-9cc1-206e860cf90f admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 14:35:03.843991 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [None req-aee53451-d952-419a-9cc1-206e860cf90f admin admin] http://10.222.0.39:9696/v2.0/extensions returned with HTTP 200 {{(pid=109061) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 14:35:03.845676 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-aee53451-d952-419a-9cc1-206e860cf90f admin admin] 10.222.0.39 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7568526 Dec 09 14:35:05.640248 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.db.l3_hamode_db [None req-b666e31e-0413-4e88-8004-0ab9d5eb70c4 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Dec 09 14:35:05.717041 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b666e31e-0413-4e88-8004-0ab9d5eb70c4 None None] Routers set() bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:35:05.717465 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b666e31e-0413-4e88-8004-0ab9d5eb70c4 None None] Router IDs set() for agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Dec 09 14:35:06.457625 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 50046) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:35:06.794127 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-cd7f2ff7-73c5-4f44-bcfe-8c208cc093d9 admin admin] Request body: {'subnetpool': {'prefixes': ['172.20.0.0/16'], 'name': 'shared-default-subnetpool-v4', 'shared': True, 'default_prefixlen': 26, 'is_default': True}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:35:06.888982 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.policy [None req-cd7f2ff7-73c5-4f44-bcfe-8c208cc093d9 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=109061) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 09 14:35:06.935077 dv-cinder-819692-8-iscsi neutron-server[109061]: WARNING oslo_policy.policy [None req-cd7f2ff7-73c5-4f44-bcfe-8c208cc093d9 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 14:35:06.935439 dv-cinder-819692-8-iscsi neutron-server[109061]: WARNING oslo_policy.policy [None req-cd7f2ff7-73c5-4f44-bcfe-8c208cc093d9 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 14:35:06.944336 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.quota [None req-cd7f2ff7-73c5-4f44-bcfe-8c208cc093d9 admin admin] Loaded quota_driver: . Dec 09 14:35:07.038116 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cd7f2ff7-73c5-4f44-bcfe-8c208cc093d9 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8747844981071', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8747844980632', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8747844933908', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8747844931085', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8747844937896', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8747844945397', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-983388', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-990991', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1580848', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1653141'] for rbac-policy, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:07.116879 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cd7f2ff7-73c5-4f44-bcfe-8c208cc093d9 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:07.120394 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-cd7f2ff7-73c5-4f44-bcfe-8c208cc093d9 admin admin] 10.222.0.39 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6614039 Dec 09 14:35:09.901378 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50058) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:35:10.421200 dv-cinder-819692-8-iscsi neutron-server[109062]: WARNING oslo_policy.policy [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 14:35:10.421796 dv-cinder-819692-8-iscsi neutron-server[109062]: WARNING oslo_policy.policy [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 14:35:10.641309 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Request body: {'network': {'name': 'private', 'project_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'tenant_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'admin_state_up': True}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:35:10.642908 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.quota [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Loaded quota_driver: . Dec 09 14:35:10.706074 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Made reservation on behalf of cb8ce3a79dda48b2a7f1f943c3465b53 for: {'network': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:35:10.775269 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.policy [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=109062) register_rules /opt/stack/neutron/neutron/policy.py:73}} Dec 09 14:35:10.821451 dv-cinder-819692-8-iscsi neutron-server[109062]: WARNING oslo_policy.policy [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 14:35:10.821819 dv-cinder-819692-8-iscsi neutron-server[109062]: WARNING oslo_policy.policy [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Dec 09 14:35:10.832232 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:10.854078 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:10.977516 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:10.983792 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:11.008461 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 413} {{(pid=109062) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:35:11.034177 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8747843008705', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:11.034752 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Unsubscribe: segment precommit_create {{(pid=109062) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 09 14:35:11.035291 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.segments_db [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Added segment c4288f97-a1bc-4061-bdaf-0964e763d958 of type vlan for network 8a0630eb-de39-4ee3-976c-b4ad4c950532 Dec 09 14:35:11.041163 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b140a8e9-f702-4f8b-95d0-68c16e309602,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:11.078022 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:11.078355 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:11.078787 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:11.079129 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:11.079461 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:11.079826 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:11.080148 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:11.080481 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:11.080820 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:11.081159 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:11.081482 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:11.081808 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:11.082122 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Tracked resource versions report: Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: pushed versions: Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: { 'AddressGroup': {'1.2'}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'ConntrackHelper': {'1.0'}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'LocalIPAssociation': {'1.0'}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Log': {'1.0'}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Network': {'1.1'}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Port': {'1.7'}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'PortForwarding': {'1.2'}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'QosPolicy': {'1.10'}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'SecurityGroup': {'1.5'}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'SecurityGroupRule': {'1.2'}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'SubPort': {'1.0'}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Subnet': {'1.1'}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Trunk': {'1.1'}} Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: consumer versions: Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: { DHCP agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: L3 agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: Metadata agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: Metering agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: Open vSwitch agent@dv-cinder-819692-8-iscsi: { 'AddressGroup': '1.2', Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'ConntrackHelper': '1.0', Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'LocalIPAssociation': '1.0', Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Log': '1.0', Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Network': '1.1', Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Port': '1.7', Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'PortForwarding': '1.2', Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'QosPolicy': '1.10', Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'SecurityGroup': '1.5', Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'SecurityGroupRule': '1.2', Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'SubPort': '1.0', Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Subnet': '1.1', Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Trunk': '1.1'}} Dec 09 14:35:11.083501 dv-cinder-819692-8-iscsi neutron-server[109062]: {{(pid=109062) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 14:35:11.151485 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:11.197401 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:11.198624 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:35:11.199322 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:11.280776 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 1.3783612 Dec 09 14:35:11.303403 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05e27221-2477-4d53-9447-9736b7783302 admin admin] Pushing event updated for resources: {'Network': ['ID=8a0630eb-de39-4ee3-976c-b4ad4c950532,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:11.317023 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network 8a0630eb-de39-4ee3-976c-b4ad4c950532 details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:35:14.119352 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 50080) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:35:14.574590 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-13a378f3-302f-4708-a439-02aa023adbfa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:35:14.576036 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-13a378f3-302f-4708-a439-02aa023adbfa admin admin] 10.222.0.39 "GET /v2.0/networks/8a0630eb-de39-4ee3-976c-b4ad4c950532 HTTP/1.1" status: 200 len: 825 time: 0.4556589 Dec 09 14:35:14.600636 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-8a1bf948-02b9-4afd-9023-eb20925161a2 admin admin] 10.222.0.39 "GET /v2.0/subnetpools/64a026bb-131a-4d35-aca2-f7cafa9f77d5 HTTP/1.1" status: 200 len: 734 time: 0.0184147 Dec 09 14:35:14.609438 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Request body: {'subnet': {'subnetpool_id': '64a026bb-131a-4d35-aca2-f7cafa9f77d5', 'tenant_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'gateway_ip': '172.20.0.1', 'ip_version': 4, 'name': 'private-subnet', 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:35:14.641412 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Made reservation on behalf of cb8ce3a79dda48b2a7f1f943c3465b53 for: {'subnet': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:35:14.643985 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Publish callbacks [] for subnet, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:14.950556 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for subnet, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:15.023533 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Checking segment: {'id': 'c4288f97-a1bc-4061-bdaf-0964e763d958', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:35:15.023962 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Network hostable DHCP agents. Network: 8a0630eb-de39-4ee3-976c-b4ad4c950532, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109061) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:35:15.026123 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Pushing event updated for resources: {'Subnet': ['ID=123b1636-37a5-4348-b751-3be9d23c5d7f,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:15.038686 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:15.039046 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:15.039413 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:15.039789 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:15.040130 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:15.040453 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:15.040895 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:15.041228 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:15.041576 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:15.041920 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:15.042250 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:15.042572 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:15.042876 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Tracked resource versions report: Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: pushed versions: Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: { 'AddressGroup': {'1.2'}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'ConntrackHelper': {'1.0'}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'LocalIPAssociation': {'1.0'}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Log': {'1.0'}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Network': {'1.1'}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Port': {'1.7'}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'PortForwarding': {'1.2'}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'QosPolicy': {'1.10'}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'SecurityGroup': {'1.5'}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'SecurityGroupRule': {'1.2'}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'SubPort': {'1.0'}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Subnet': {'1.1'}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Trunk': {'1.1'}} Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: consumer versions: Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: { DHCP agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: L3 agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: Metadata agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: Metering agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: Open vSwitch agent@dv-cinder-819692-8-iscsi: { 'AddressGroup': '1.2', Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'ConntrackHelper': '1.0', Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'LocalIPAssociation': '1.0', Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Log': '1.0', Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Network': '1.1', Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Port': '1.7', Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'PortForwarding': '1.2', Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'QosPolicy': '1.10', Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'SecurityGroup': '1.5', Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'SecurityGroupRule': '1.2', Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'SubPort': '1.0', Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Subnet': '1.1', Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Trunk': '1.1'}} Dec 09 14:35:15.044298 dv-cinder-819692-8-iscsi neutron-server[109061]: {{(pid=109061) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 14:35:15.083128 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Network 8a0630eb-de39-4ee3-976c-b4ad4c950532 is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109061) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:35:15.101208 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, 8a0630eb-de39-4ee3-976c-b4ad4c950532) {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:35:15.106188 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:35:15.106839 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:15.111952 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-00730d5e-89d0-4036-98af-3d27b1a99ff9 None None] Network 8a0630eb-de39-4ee3-976c-b4ad4c950532 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:35:15.123969 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-ce09a156-67c2-45b8-9e15-33a5da14ac8b admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.5177405 Dec 09 14:35:15.379062 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp191c2114-7e35-566a-a422-2a0bb50a5442-8a0630eb-de39-4ee3-976c-b4ad4c950532', 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532', 'project_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'fixed_ips': [{'subnet_id': '123b1636-37a5-4348-b751-3be9d23c5d7f'}]}} from dv-cinder-819692-8-iscsi. {{(pid=109063) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 14:35:15.380500 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:15.680751 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.db_base_plugin_common [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Allocated IP 172.20.0.2 (8a0630eb-de39-4ee3-976c-b4ad4c950532/123b1636-37a5-4348-b751-3be9d23c5d7f/1d70337c-3463-466d-9d9d-a5277b17694a) {{(pid=109063) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:35:15.921458 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Publish callbacks [] for port, precommit_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:15.929570 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:16.003855 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Network 8a0630eb-de39-4ee3-976c-b4ad4c950532 is already hosted by enough agents. {{(pid=109063) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:35:16.014164 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.base_scheduler [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Resources bound (agent type, host, resource id): {{(pid=109063) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:35:16.020547 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Received port after_create {{(pid=109063) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:35:16.025362 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Pushing event updated for resources: {'Port': ['ID=1d70337c-3463-466d-9d9d-a5277b17694a,revision_number=1']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:16.035913 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:16.036343 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:16.036707 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:16.037082 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:16.037419 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:16.037757 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:16.038078 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:16.038402 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:16.038710 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:16.039059 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:16.039386 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:16.039729 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:16.040056 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Tracked resource versions report: Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: pushed versions: Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: { 'AddressGroup': {'1.2'}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'ConntrackHelper': {'1.0'}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'LocalIPAssociation': {'1.0'}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Log': {'1.0'}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Network': {'1.1'}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Port': {'1.7'}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'PortForwarding': {'1.2'}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'QosPolicy': {'1.10'}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'SecurityGroup': {'1.5'}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'SecurityGroupRule': {'1.2'}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'SubPort': {'1.0'}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Subnet': {'1.1'}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Trunk': {'1.1'}} Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: consumer versions: Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: { DHCP agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: L3 agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: Metadata agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: Metering agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: Open vSwitch agent@dv-cinder-819692-8-iscsi: { 'AddressGroup': '1.2', Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'ConntrackHelper': '1.0', Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'LocalIPAssociation': '1.0', Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Log': '1.0', Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Network': '1.1', Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Port': '1.7', Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'PortForwarding': '1.2', Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'QosPolicy': '1.10', Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'SecurityGroup': '1.5', Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'SecurityGroupRule': '1.2', Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'SubPort': '1.0', Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Subnet': '1.1', Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Trunk': '1.1'}} Dec 09 14:35:16.041506 dv-cinder-819692-8-iscsi neutron-server[109063]: {{(pid=109063) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 14:35:16.113985 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Attempting to bind port 1d70337c-3463-466d-9d9d-a5277b17694a on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:35:16.114693 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Attempting to bind port 1d70337c-3463-466d-9d9d-a5277b17694a by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'c4288f97-a1bc-4061-bdaf-0964e763d958', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:35:16.114804 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Attempting to bind port 1d70337c-3463-466d-9d9d-a5277b17694a on network 8a0630eb-de39-4ee3-976c-b4ad4c950532 {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:35:16.120500 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 35, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:35:16.120894 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Checking segment: {'id': 'c4288f97-a1bc-4061-bdaf-0964e763d958', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:35:16.121410 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:16.121806 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Bound using segment: {'id': 'c4288f97-a1bc-4061-bdaf-0964e763d958', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:35:16.122292 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Bound port: 1d70337c-3463-466d-9d9d-a5277b17694a, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c4288f97-a1bc-4061-bdaf-0964e763d958', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:35:16.122691 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:16.187534 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] For port 1d70337c-3463-466d-9d9d-a5277b17694a, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:35:16.191879 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] For port 1d70337c-3463-466d-9d9d-a5277b17694a, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=1d70337c-3463-466d-9d9d-a5277b17694a,segment=NetworkSegment(c4288f97-a1bc-4061-bdaf-0964e763d958),segment_id=c4288f97-a1bc-4061-bdaf-0964e763d958)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:35:16.198059 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:16.261435 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea1e776f-7d21-43d7-8bb3-97055ca5e3b7 None None] Pushing event updated for resources: {'Port': ['ID=1d70337c-3463-466d-9d9d-a5277b17694a,revision_number=2']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:17.775708 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 50092) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:35:18.092083 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [None req-bb642cc7-639c-46bf-a621-99343abd0755 admin admin] http://10.222.0.39:9696/v2.0/extensions returned with HTTP 200 {{(pid=109061) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 14:35:18.096161 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-bb642cc7-639c-46bf-a621-99343abd0755 admin admin] 10.222.0.39 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3192859 Dec 09 14:35:20.663430 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 50100) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:35:20.990516 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [None req-aa5f2dcd-a008-488a-8e86-2c98cdb69734 admin admin] http://10.222.0.39:9696/v2.0/extensions returned with HTTP 200 {{(pid=109061) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 14:35:20.991514 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-aa5f2dcd-a008-488a-8e86-2c98cdb69734 admin admin] 10.222.0.39 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3270617 Dec 09 14:35:23.812160 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50112) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:35:24.125896 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-ba528811-65e1-4e60-b5d5-6c9eb1abd047 admin admin] Request body: {'router': {'admin_state_up': True, 'tenant_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'name': 'router1'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:35:24.153198 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ba528811-65e1-4e60-b5d5-6c9eb1abd047 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1626853', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30590'] for router, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:24.154357 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ba528811-65e1-4e60-b5d5-6c9eb1abd047 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1626745', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1584168', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1653733', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30569'] for router, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:24.297614 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ba528811-65e1-4e60-b5d5-6c9eb1abd047 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:24.305007 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ba528811-65e1-4e60-b5d5-6c9eb1abd047 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1626736', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1574391'] for router, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:24.320823 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ba528811-65e1-4e60-b5d5-6c9eb1abd047 admin admin] Publish callbacks [] for router, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:24.322080 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-ba528811-65e1-4e60-b5d5-6c9eb1abd047 admin admin] 10.222.0.39 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.5089123 Dec 09 14:35:24.427062 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 1d70337c-3463-466d-9d9d-a5277b17694a up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:35:24.523580 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 1d70337c-3463-466d-9d9d-a5277b17694a triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:35:24.524068 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:24.641873 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:24.677695 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] For port 1d70337c-3463-466d-9d9d-a5277b17694a, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=1d70337c-3463-466d-9d9d-a5277b17694a,segment=NetworkSegment(c4288f97-a1bc-4061-bdaf-0964e763d958),segment_id=c4288f97-a1bc-4061-bdaf-0964e763d958)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:35:24.682730 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:24.737845 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Pushing event updated for resources: {'Port': ['ID=1d70337c-3463-466d-9d9d-a5277b17694a,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:25.269665 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64a3e4e8-740d-4898-9f36-08aa012aee8c None None] Network 8a0630eb-de39-4ee3-976c-b4ad4c950532 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:35:25.372306 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-b0fae7cf-11c7-4231-ae8e-b657448c95c0 None None] Provisioning complete for port 1d70337c-3463-466d-9d9d-a5277b17694a triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:35:25.372677 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-b0fae7cf-11c7-4231-ae8e-b657448c95c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:25.425481 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 5 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:35:25.593618 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-000fe9a3-dc75-4b98-aaf9-84953cf0a387 None None] Provisioning complete for port 1d70337c-3463-466d-9d9d-a5277b17694a triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:35:25.594204 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-000fe9a3-dc75-4b98-aaf9-84953cf0a387 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:26.401468 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 1d70337c-3463-466d-9d9d-a5277b17694a up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:35:26.451416 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 1d70337c-3463-466d-9d9d-a5277b17694a triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:35:26.451819 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:26.930060 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50122) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:35:26.945231 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-e5f75aad-822f-42fc-9978-fa92ce950499 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:27.262048 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [None req-3765d3a2-8a77-49ee-81bd-d212377be70e admin admin] http://10.222.0.39:9696/v2.0/extensions returned with HTTP 200 {{(pid=109062) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 14:35:27.263065 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-3765d3a2-8a77-49ee-81bd-d212377be70e admin admin] 10.222.0.39 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3316736 Dec 09 14:35:29.163380 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-b894c721-5f9a-4b2a-b222-b45fe1e20daf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:29.849427 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50130) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:35:30.191153 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] Request body: {'network': {'admin_state_up': True, 'provider:physical_network': 'physnet1', 'is_default': True, 'router:external': True, 'provider:network_type': 'flat', 'name': 'public'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:35:30.214054 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] Made reservation on behalf of 500bcf2a09804a81b7cadce780546297 for: {'network': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:35:30.216462 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:30.224304 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:30.297763 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:30.303348 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:30.322425 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] Reserving flat network on physical network physnet1 {{(pid=109062) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Dec 09 14:35:30.339991 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18735c84-7781-4701-ac57-a4a2fb2935b7,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:30.345744 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:30.346094 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.segments_db [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] Added segment f0f2cb71-999b-4f79-9acb-b9cd907fc3ab of type flat for network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c Dec 09 14:35:30.352567 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:30.404601 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:30.441107 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:30.442477 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:35:30.443299 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:30.497507 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.6468468 Dec 09 14:35:30.506140 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47445dac-e1e8-4da8-90ef-d0ed4115af6a admin admin] Pushing event updated for resources: {'Network': ['ID=ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:30.516927 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:35:31.746152 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:32.610363 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:33.070778 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50148) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:35:33.317729 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-57504bed-534b-4415-8336-ca1bcf56f243 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:35:33.319151 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-57504bed-534b-4415-8336-ca1bcf56f243 admin admin] 10.222.0.39 "GET /v2.0/subnets/123b1636-37a5-4348-b751-3be9d23c5d7f HTTP/1.1" status: 200 len: 849 time: 0.2473891 Dec 09 14:35:33.437075 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-d17ae8f8-3db0-4b59-b8cc-623af01a0dd0 admin admin] 10.222.0.39 "GET /v2.0/routers/76a11b0e-dc03-4b69-a62c-7929518e2c2e HTTP/1.1" status: 200 len: 704 time: 0.1114745 Dec 09 14:35:33.708189 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:34.005392 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Allocated IP 172.20.0.1 (8a0630eb-de39-4ee3-976c-b4ad4c950532/123b1636-37a5-4348-b751-3be9d23c5d7f/82ef815b-e2a6-4def-b426-2c9b6bf40201) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:35:34.199451 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:34.271524 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:34.351073 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Network 8a0630eb-de39-4ee3-976c-b4ad4c950532 is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:35:34.355948 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:35:34.361354 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Pushing event updated for resources: {'Port': ['ID=82ef815b-e2a6-4def-b426-2c9b6bf40201,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:34.372975 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:35:34.373438 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1574184'] for router_interface, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:34.519419 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-6dbfc017-a0cf-4ed2-ad0e-b50ec9b7d1f6 None None] Provisioning complete for port 82ef815b-e2a6-4def-b426-2c9b6bf40201 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:35:34.519987 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-6dbfc017-a0cf-4ed2-ad0e-b50ec9b7d1f6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:34.553415 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-6dbfc017-a0cf-4ed2-ad0e-b50ec9b7d1f6 None None] Port 82ef815b-e2a6-4def-b426-2c9b6bf40201 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:35:34.626239 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:34.834018 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:34.841338 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:34.842106 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2066007', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1629368'] for router_interface, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:34.915664 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Pushing event updated for resources: {'Port': ['ID=82ef815b-e2a6-4def-b426-2c9b6bf40201,revision_number=2']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:34.964786 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Network 8a0630eb-de39-4ee3-976c-b4ad4c950532 is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:35:34.966129 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:35:35.131502 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Router 76a11b0e-dc03-4b69-a62c-7929518e2c2e is scheduled to L3 agent d9048829-2654-4d94-83cc-155a0884505e with binding_index 1 {{(pid=109062) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 14:35:35.176070 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-948abd97-6ca8-4353-a86b-5ce492b52198 None None] Provisioning complete for port 82ef815b-e2a6-4def-b426-2c9b6bf40201 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:35:35.176416 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-948abd97-6ca8-4353-a86b-5ce492b52198 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:35.212526 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-948abd97-6ca8-4353-a86b-5ce492b52198 None None] Port 82ef815b-e2a6-4def-b426-2c9b6bf40201 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:35:35.221873 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:35:35.227290 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-d4e83267-fac4-449a-b715-573e2bd8c3e7 admin admin] 10.222.0.39 "PUT /v2.0/routers/76a11b0e-dc03-4b69-a62c-7929518e2c2e/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.7813561 Dec 09 14:35:35.232550 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Sync routers for ids ['76a11b0e-dc03-4b69-a62c-7929518e2c2e'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:35:35.246112 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Routers {'76a11b0e-dc03-4b69-a62c-7929518e2c2e'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:35:35.246856 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:35:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['76a11b0e-dc03-4b69-a62c-7929518e2c2e'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:35:35.434004 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Set router 76a11b0e-dc03-4b69-a62c-7929518e2c2e gateway port host: None {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:35:35.864890 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '76a11b0e-dc03-4b69-a62c-7929518e2c2e', 'name': 'router1', 'tenant_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:35:24Z', 'updated_at': '2021-12-09T14:35:34Z', 'revision_number': 2, 'project_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'gw_port_host': None, '_interfaces': [{'id': '82ef815b-e2a6-4def-b426-2c9b6bf40201', 'name': '', 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532', 'tenant_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'mac_address': 'fa:16:3e:01:c5:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '76a11b0e-dc03-4b69-a62c-7929518e2c2e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '123b1636-37a5-4348-b751-3be9d23c5d7f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:35:33Z', 'updated_at': '2021-12-09T14:35:34Z', 'revision_number': 2, 'project_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'subnets': [{'id': '123b1636-37a5-4348-b751-3be9d23c5d7f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '64a026bb-131a-4d35-aca2-f7cafa9f77d5'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:35:35.915568 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Checking router: 76a11b0e-dc03-4b69-a62c-7929518e2c2e for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:35:35.915971 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Updating router 76a11b0e-dc03-4b69-a62c-7929518e2c2e port 82ef815b-e2a6-4def-b426-2c9b6bf40201 binding host dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:35:35.964181 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:36.470364 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Publish callbacks [] for port, precommit_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:36.479334 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:36.631949 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Pushing event updated for resources: {'Port': ['ID=82ef815b-e2a6-4def-b426-2c9b6bf40201,revision_number=3']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:36.650558 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Attempting to bind port 82ef815b-e2a6-4def-b426-2c9b6bf40201 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:35:36.650968 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Attempting to bind port 82ef815b-e2a6-4def-b426-2c9b6bf40201 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'c4288f97-a1bc-4061-bdaf-0964e763d958', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532'}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:35:36.651389 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Attempting to bind port 82ef815b-e2a6-4def-b426-2c9b6bf40201 on network 8a0630eb-de39-4ee3-976c-b4ad4c950532 {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:35:36.654970 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:36.655319 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:36.655698 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:36.656163 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:36.656497 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:36.656826 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:36.657185 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:36.657514 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:36.657837 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:36.658159 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:36.658487 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:36.658806 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:36.659123 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Tracked resource versions report: Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: pushed versions: Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: { 'AddressGroup': {'1.2'}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'ConntrackHelper': {'1.0'}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'LocalIPAssociation': {'1.0'}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Log': {'1.0'}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Network': {'1.1'}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Port': {'1.7'}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'PortForwarding': {'1.2'}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'QosPolicy': {'1.10'}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'SecurityGroup': {'1.5'}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'SecurityGroupRule': {'1.2'}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'SubPort': {'1.0'}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Subnet': {'1.1'}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Trunk': {'1.1'}} Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: consumer versions: Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: { DHCP agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: L3 agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: Metadata agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: Metering agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: Open vSwitch agent@dv-cinder-819692-8-iscsi: { 'AddressGroup': '1.2', Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'ConntrackHelper': '1.0', Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'LocalIPAssociation': '1.0', Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Log': '1.0', Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Network': '1.1', Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Port': '1.7', Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'PortForwarding': '1.2', Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'QosPolicy': '1.10', Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'SecurityGroup': '1.5', Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'SecurityGroupRule': '1.2', Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'SubPort': '1.0', Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Subnet': '1.1', Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Trunk': '1.1'}} Dec 09 14:35:36.660576 dv-cinder-819692-8-iscsi neutron-server[109064]: {{(pid=109064) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 14:35:36.665571 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 35, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:35:36.665989 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Checking segment: {'id': 'c4288f97-a1bc-4061-bdaf-0964e763d958', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109064) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:35:36.666458 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:36.666838 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Bound using segment: {'id': 'c4288f97-a1bc-4061-bdaf-0964e763d958', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532'} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:35:36.667338 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Bound port: 82ef815b-e2a6-4def-b426-2c9b6bf40201, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c4288f97-a1bc-4061-bdaf-0964e763d958', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 413, 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532'}}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:35:36.667741 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:36.734012 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] For port 82ef815b-e2a6-4def-b426-2c9b6bf40201, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109064) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:35:36.743906 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-1db77f7a-8da3-4819-8451-caff5b2f403f None None] Provisioning complete for port 82ef815b-e2a6-4def-b426-2c9b6bf40201 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:35:36.744451 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-1db77f7a-8da3-4819-8451-caff5b2f403f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:36.754837 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] For port 82ef815b-e2a6-4def-b426-2c9b6bf40201, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=82ef815b-e2a6-4def-b426-2c9b6bf40201,segment=NetworkSegment(c4288f97-a1bc-4061-bdaf-0964e763d958),segment_id=c4288f97-a1bc-4061-bdaf-0964e763d958)] {{(pid=109064) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:35:36.760183 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:36.778016 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-1db77f7a-8da3-4819-8451-caff5b2f403f None None] Port 82ef815b-e2a6-4def-b426-2c9b6bf40201 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:35:36.809103 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d12c65e2-9913-4b27-9578-9cf7461e1ee3 None None] Pushing event updated for resources: {'Port': ['ID=82ef815b-e2a6-4def-b426-2c9b6bf40201,revision_number=4']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:36.838744 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Routers {'76a11b0e-dc03-4b69-a62c-7929518e2c2e'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:35:36.839403 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:35:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['76a11b0e-dc03-4b69-a62c-7929518e2c2e'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:35:36.931510 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] Set router 76a11b0e-dc03-4b69-a62c-7929518e2c2e gateway port host: None {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:35:36.998582 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-acdcc555-a67b-4a6b-8820-387f61b1766d None None] Provisioning complete for port 82ef815b-e2a6-4def-b426-2c9b6bf40201 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:35:36.999131 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-acdcc555-a67b-4a6b-8820-387f61b1766d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:37.078393 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-acdcc555-a67b-4a6b-8820-387f61b1766d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:37.109623 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-acdcc555-a67b-4a6b-8820-387f61b1766d None None] For port 82ef815b-e2a6-4def-b426-2c9b6bf40201, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=82ef815b-e2a6-4def-b426-2c9b6bf40201,segment=NetworkSegment(c4288f97-a1bc-4061-bdaf-0964e763d958),segment_id=c4288f97-a1bc-4061-bdaf-0964e763d958)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:35:37.114665 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-acdcc555-a67b-4a6b-8820-387f61b1766d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:37.137756 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '76a11b0e-dc03-4b69-a62c-7929518e2c2e', 'name': 'router1', 'tenant_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:35:24Z', 'updated_at': '2021-12-09T14:35:34Z', 'revision_number': 2, 'project_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'gw_port_host': None, '_interfaces': [{'id': '82ef815b-e2a6-4def-b426-2c9b6bf40201', 'name': '', 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532', 'tenant_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'mac_address': 'fa:16:3e:01:c5:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '76a11b0e-dc03-4b69-a62c-7929518e2c2e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '123b1636-37a5-4348-b751-3be9d23c5d7f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:35:33Z', 'updated_at': '2021-12-09T14:35:36Z', 'revision_number': 4, 'project_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'subnets': [{'id': '123b1636-37a5-4348-b751-3be9d23c5d7f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '64a026bb-131a-4d35-aca2-f7cafa9f77d5'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:35:37.162029 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acdcc555-a67b-4a6b-8820-387f61b1766d None None] Pushing event updated for resources: {'Port': ['ID=82ef815b-e2a6-4def-b426-2c9b6bf40201,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:37.166326 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d61a5f6-14f9-4ede-ba19-97eac2e065ad None None] The sync data for ids ['76a11b0e-dc03-4b69-a62c-7929518e2c2e'] in dv-cinder-819692-8-iscsi is: [{'id': '76a11b0e-dc03-4b69-a62c-7929518e2c2e', 'name': 'router1', 'tenant_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:35:24Z', 'updated_at': '2021-12-09T14:35:34Z', 'revision_number': 2, 'project_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'gw_port_host': None, '_interfaces': [{'id': '82ef815b-e2a6-4def-b426-2c9b6bf40201', 'name': '', 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532', 'tenant_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'mac_address': 'fa:16:3e:01:c5:71', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '76a11b0e-dc03-4b69-a62c-7929518e2c2e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '123b1636-37a5-4348-b751-3be9d23c5d7f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:35:33Z', 'updated_at': '2021-12-09T14:35:36Z', 'revision_number': 4, 'project_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'subnets': [{'id': '123b1636-37a5-4348-b751-3be9d23c5d7f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '64a026bb-131a-4d35-aca2-f7cafa9f77d5'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:35:37.644152 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 50172) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:35:37.762736 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-799eee2b-994b-4c5a-aa27-b42e026ead56 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:35:37.764173 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-799eee2b-994b-4c5a-aa27-b42e026ead56 admin admin] 10.222.0.39 "GET /v2.0/networks/ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c HTTP/1.1" status: 200 len: 842 time: 0.1190772 Dec 09 14:35:37.774517 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-e4718a2a-faba-4f38-9654-b15551704e8b admin admin] Request body: {'subnet': {'ip_version': 4, 'name': 'public-subnet', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'cidr': '172.27.0.0/24', 'enable_dhcp': False, 'gateway_ip': '172.27.0.1'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:35:37.798382 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e4718a2a-faba-4f38-9654-b15551704e8b admin admin] Made reservation on behalf of 500bcf2a09804a81b7cadce780546297 for: {'subnet': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:35:37.800872 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e4718a2a-faba-4f38-9654-b15551704e8b admin admin] Publish callbacks [] for subnet, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:38.150840 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.objects.ports [None req-e4718a2a-faba-4f38-9654-b15551704e8b admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=109061) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Dec 09 14:35:38.151297 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e4718a2a-faba-4f38-9654-b15551704e8b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for subnet, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:38.207099 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4718a2a-faba-4f38-9654-b15551704e8b admin admin] Pushing event updated for resources: {'Subnet': ['ID=e694bbf8-2176-4a1d-9b13-4712a7fb8309,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:38.218427 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e4718a2a-faba-4f38-9654-b15551704e8b admin admin] Checking segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:35:38.218786 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4718a2a-faba-4f38-9654-b15551704e8b admin admin] Network hostable DHCP agents. Network: ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109061) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:35:38.236560 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e4718a2a-faba-4f38-9654-b15551704e8b admin admin] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109061) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:35:38.246759 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-e4718a2a-faba-4f38-9654-b15551704e8b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c) {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:35:38.251821 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e4718a2a-faba-4f38-9654-b15551704e8b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:35:38.252448 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e4718a2a-faba-4f38-9654-b15551704e8b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:38.262180 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a09c83bf-5178-43e8-a8a4-c973fe867f56 None None] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:35:38.285606 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-e4718a2a-faba-4f38-9654-b15551704e8b admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.5027435 Dec 09 14:35:38.381921 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c49d606e-1812-470b-933d-f4069a85b0a4 None None] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:35:40.723439 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 50180) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:35:40.966187 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-1cb2951c-bfcb-40e6-9d3d-a6eeec3c094d admin admin] 10.222.0.39 "GET /v2.0/routers/76a11b0e-dc03-4b69-a62c-7929518e2c2e HTTP/1.1" status: 200 len: 710 time: 0.2413802 Dec 09 14:35:41.051375 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7b17ff74-f929-409b-86b9-637ed1792935 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:35:41.052801 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-7b17ff74-f929-409b-86b9-637ed1792935 admin admin] 10.222.0.39 "GET /v2.0/networks/ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c HTTP/1.1" status: 200 len: 886 time: 0.0808029 Dec 09 14:35:41.062342 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Request body: {'router': {'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:35:41.310763 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:41.565792 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:41.647956 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:41.840913 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Allocated IP 172.27.0.247 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/e5250d02-f2a4-4841-830a-53686f7d2ca2) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:35:41.952150 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:42.016766 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:42.058196 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:35:42.084250 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:35:42.095702 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:35:42.178918 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Pushing event updated for resources: {'Port': ['ID=e5250d02-f2a4-4841-830a-53686f7d2ca2,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:42.398848 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:42.610145 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1574354', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1626727', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-30619'] for router, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:42.618488 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1574391', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1574345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1574336', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1626654'] for router, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:42.731069 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Router 76a11b0e-dc03-4b69-a62c-7929518e2c2e has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:35:42.840706 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:35:42.845616 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:42.846822 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-af677e2e-afc1-42aa-9a5f-673f871c426c admin admin] 10.222.0.39 "PUT /v2.0/routers/76a11b0e-dc03-4b69-a62c-7929518e2c2e HTTP/1.1" status: 200 len: 890 time: 1.7877450 Dec 09 14:35:44.078498 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Sync routers for ids ['76a11b0e-dc03-4b69-a62c-7929518e2c2e'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:35:44.090321 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Routers {'76a11b0e-dc03-4b69-a62c-7929518e2c2e'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:35:44.090974 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:35:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['76a11b0e-dc03-4b69-a62c-7929518e2c2e'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:35:44.300144 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Set router 76a11b0e-dc03-4b69-a62c-7929518e2c2e gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:35:44.447541 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 82ef815b-e2a6-4def-b426-2c9b6bf40201 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:35:44.639288 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 82ef815b-e2a6-4def-b426-2c9b6bf40201 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:35:44.639662 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:44.874517 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '76a11b0e-dc03-4b69-a62c-7929518e2c2e', 'name': 'router1', 'tenant_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'e5250d02-f2a4-4841-830a-53686f7d2ca2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:35:24Z', 'updated_at': '2021-12-09T14:35:42Z', 'revision_number': 4, 'project_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'gw_port': {'id': 'e5250d02-f2a4-4841-830a-53686f7d2ca2', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:46:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '76a11b0e-dc03-4b69-a62c-7929518e2c2e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:35:41Z', 'updated_at': '2021-12-09T14:35:41Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '82ef815b-e2a6-4def-b426-2c9b6bf40201', 'name': '', 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532', 'tenant_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'mac_address': 'fa:16:3e:01:c5:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '76a11b0e-dc03-4b69-a62c-7929518e2c2e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '123b1636-37a5-4348-b751-3be9d23c5d7f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:35:33Z', 'updated_at': '2021-12-09T14:35:37Z', 'revision_number': 5, 'project_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'subnets': [{'id': '123b1636-37a5-4348-b751-3be9d23c5d7f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '64a026bb-131a-4d35-aca2-f7cafa9f77d5'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:35:44.927404 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Checking router: 76a11b0e-dc03-4b69-a62c-7929518e2c2e for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:35:44.927677 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Updating router 76a11b0e-dc03-4b69-a62c-7929518e2c2e port e5250d02-f2a4-4841-830a-53686f7d2ca2 binding host dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:35:44.977434 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:45.290373 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Publish callbacks [] for port, precommit_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:45.297633 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:45.351133 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Attempting to bind port e5250d02-f2a4-4841-830a-53686f7d2ca2 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:35:45.351513 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Attempting to bind port e5250d02-f2a4-4841-830a-53686f7d2ca2 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:35:45.351906 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Attempting to bind port e5250d02-f2a4-4841-830a-53686f7d2ca2 on network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:35:45.353732 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cdebc49-9772-48f9-a39e-d1b459cbcd5b None None] Pushing event updated for resources: {'Port': ['ID=e5250d02-f2a4-4841-830a-53686f7d2ca2,revision_number=2']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:45.359087 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 35, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:35:45.359463 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Checking segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:35:45.359916 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:45.360442 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Bound using segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:35:45.360782 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Bound port: e5250d02-f2a4-4841-830a-53686f7d2ca2, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:35:45.361164 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:45.378267 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50192) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:35:45.411883 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] For port e5250d02-f2a4-4841-830a-53686f7d2ca2, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:35:45.414902 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] For port e5250d02-f2a4-4841-830a-53686f7d2ca2, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=e5250d02-f2a4-4841-830a-53686f7d2ca2,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:35:45.421979 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:45.478386 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Routers {'76a11b0e-dc03-4b69-a62c-7929518e2c2e'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:35:45.478985 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:35:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['76a11b0e-dc03-4b69-a62c-7929518e2c2e'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:35:45.491562 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-a7e51df5-8698-41c8-b28d-e58215189134 admin admin] 10.222.0.39 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1121256 Dec 09 14:35:45.516715 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cdebc49-9772-48f9-a39e-d1b459cbcd5b None None] Pushing event updated for resources: {'Port': ['ID=e5250d02-f2a4-4841-830a-53686f7d2ca2,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:45.599289 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] Set router 76a11b0e-dc03-4b69-a62c-7929518e2c2e gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:35:45.816687 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '76a11b0e-dc03-4b69-a62c-7929518e2c2e', 'name': 'router1', 'tenant_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'e5250d02-f2a4-4841-830a-53686f7d2ca2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:35:24Z', 'updated_at': '2021-12-09T14:35:42Z', 'revision_number': 4, 'project_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'gw_port': {'id': 'e5250d02-f2a4-4841-830a-53686f7d2ca2', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:46:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '76a11b0e-dc03-4b69-a62c-7929518e2c2e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:35:41Z', 'updated_at': '2021-12-09T14:35:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '82ef815b-e2a6-4def-b426-2c9b6bf40201', 'name': '', 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532', 'tenant_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'mac_address': 'fa:16:3e:01:c5:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '76a11b0e-dc03-4b69-a62c-7929518e2c2e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '123b1636-37a5-4348-b751-3be9d23c5d7f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:35:33Z', 'updated_at': '2021-12-09T14:35:37Z', 'revision_number': 5, 'project_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'subnets': [{'id': '123b1636-37a5-4348-b751-3be9d23c5d7f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '64a026bb-131a-4d35-aca2-f7cafa9f77d5'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:35:45.842046 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-008ab2bb-1147-4034-889a-e7b55c7cb3d5 None None] The sync data for ids ['76a11b0e-dc03-4b69-a62c-7929518e2c2e'] in dv-cinder-819692-8-iscsi is: [{'id': '76a11b0e-dc03-4b69-a62c-7929518e2c2e', 'name': 'router1', 'tenant_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.247'}], 'enable_snat': True}, 'gw_port_id': 'e5250d02-f2a4-4841-830a-53686f7d2ca2', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:35:24Z', 'updated_at': '2021-12-09T14:35:42Z', 'revision_number': 4, 'project_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'gw_port': {'id': 'e5250d02-f2a4-4841-830a-53686f7d2ca2', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:3c:46:c1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '76a11b0e-dc03-4b69-a62c-7929518e2c2e', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.247', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:35:41Z', 'updated_at': '2021-12-09T14:35:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '82ef815b-e2a6-4def-b426-2c9b6bf40201', 'name': '', 'network_id': '8a0630eb-de39-4ee3-976c-b4ad4c950532', 'tenant_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'mac_address': 'fa:16:3e:01:c5:71', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '76a11b0e-dc03-4b69-a62c-7929518e2c2e', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '123b1636-37a5-4348-b751-3be9d23c5d7f', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:35:33Z', 'updated_at': '2021-12-09T14:35:37Z', 'revision_number': 5, 'project_id': 'cb8ce3a79dda48b2a7f1f943c3465b53', 'subnets': [{'id': '123b1636-37a5-4348-b751-3be9d23c5d7f', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '64a026bb-131a-4d35-aca2-f7cafa9f77d5'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:35:46.475350 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device e5250d02-f2a4-4841-830a-53686f7d2ca2 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:35:46.528742 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port e5250d02-f2a4-4841-830a-53686f7d2ca2 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:35:46.529118 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:46.610372 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:46.630447 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] For port e5250d02-f2a4-4841-830a-53686f7d2ca2, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=e5250d02-f2a4-4841-830a-53686f7d2ca2,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:35:46.635814 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:46.684584 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Pushing event updated for resources: {'Port': ['ID=e5250d02-f2a4-4841-830a-53686f7d2ca2,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:35:48.444181 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device e5250d02-f2a4-4841-830a-53686f7d2ca2 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:35:48.502402 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port e5250d02-f2a4-4841-830a-53686f7d2ca2 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:35:48.503052 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:56.941000 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-9c6cab66-fdfa-4d2b-94e9-e745d011d444 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:35:59.169934 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-6e0c81d9-57c5-44bf-98cd-6934e9c740cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:36:00.355649 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:36:01.758592 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:36:02.427747 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 5 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:36:02.624919 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:36:26.948637 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4a0a3f86-acc9-4bb8-9639-3fc01ed1e1ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:36:29.168189 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f6934041-573c-4423-9bd8-2555650d73ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:36:30.358124 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:36:31.748496 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:36:32.609464 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:36:39.427653 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 5 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:36:56.945307 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-44dbb33d-16ed-4375-ab8f-b1387a1a97b4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:36:59.162499 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-48b84e1e-1de3-4a38-9629-0c0ee90f902a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:00.363412 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:01.753288 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:02.615640 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:05.818109 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50676) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:37:05.888905 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.pecan_wsgi.hooks.translation [None req-8f81f0a5-35d4-4d0e-8294-379ca67687e2 admin admin] GET failed (client error): The resource could not be found. Dec 09 14:37:05.890204 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-8f81f0a5-35d4-4d0e-8294-379ca67687e2 admin admin] 10.222.0.39 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0707688 Dec 09 14:37:06.055007 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3017c9e7-a0e0-4716-999a-4d36820a4ae8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:06.056509 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-3017c9e7-a0e0-4716-999a-4d36820a4ae8 admin admin] 10.222.0.39 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1591601 Dec 09 14:37:08.434004 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 50686) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:37:08.533032 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-be9437ab-fa30-4318-9623-247eb1ad6ef9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:08.534414 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-be9437ab-fa30-4318-9623-247eb1ad6ef9 admin admin] 10.222.0.39 "GET /v2.0/subnets/123b1636-37a5-4348-b751-3be9d23c5d7f HTTP/1.1" status: 200 len: 849 time: 0.0994534 Dec 09 14:37:08.544904 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:37:08.635059 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Publish callbacks [] for subnet, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:08.787466 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8747843042088'] for subnet, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:08.819084 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:08.819973 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:08.835880 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] 10.222.0.39 "PUT /v2.0/subnets/123b1636-37a5-4348-b751-3be9d23c5d7f HTTP/1.1" status: 200 len: 868 time: 0.2798932 Dec 09 14:37:08.836120 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f682a429-cbc4-436f-b9e7-1c777ce1d985 None None] Network 8a0630eb-de39-4ee3-976c-b4ad4c950532 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:37:08.840029 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=123b1636-37a5-4348-b751-3be9d23c5d7f,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:37:08.847811 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:08.848190 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:08.848542 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:08.848887 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:08.849253 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:08.849552 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:08.849917 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:08.850258 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:08.850592 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:08.850924 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:08.851272 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:08.851565 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:08.851919 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-52db6704-fda4-44e1-8bfa-e65d3bd2f7e6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:09.160917 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-e01b7419-9624-4a9a-be9b-38683f1ac85b None None] Provisioning complete for port 82ef815b-e2a6-4def-b426-2c9b6bf40201 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:37:09.161289 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-e01b7419-9624-4a9a-be9b-38683f1ac85b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:09.255331 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-e01b7419-9624-4a9a-be9b-38683f1ac85b None None] Provisioning complete for port 1d70337c-3463-466d-9d9d-a5277b17694a triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:37:09.255331 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-e01b7419-9624-4a9a-be9b-38683f1ac85b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:11.194552 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50696) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:37:11.416615 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39fd50f3-e163-4e33-8025-2aa0b0884984 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:11.416976 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39fd50f3-e163-4e33-8025-2aa0b0884984 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:11.418597 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-39fd50f3-e163-4e33-8025-2aa0b0884984 admin admin] 10.222.0.39 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2231019 Dec 09 14:37:13.779907 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50704) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:37:13.924163 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f7c70d6-d6d1-4e6a-a48b-905e93788ddc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:13.924648 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8f7c70d6-d6d1-4e6a-a48b-905e93788ddc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:13.926154 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-8f7c70d6-d6d1-4e6a-a48b-905e93788ddc admin admin] 10.222.0.39 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1452956 Dec 09 14:37:16.281467 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50712) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:37:16.428033 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 5 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:37:16.508202 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3da616ae-5fed-4d7a-87d5-c3971fc7be70 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:16.509607 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-3da616ae-5fed-4d7a-87d5-c3971fc7be70 admin admin] 10.222.0.39 "GET /v2.0/networks/8a0630eb-de39-4ee3-976c-b4ad4c950532 HTTP/1.1" status: 200 len: 869 time: 0.2271366 Dec 09 14:37:18.841776 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50720) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:37:18.975749 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5c5bf544-6442-4e9c-a26a-3bcdc99faef6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:18.977072 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-5c5bf544-6442-4e9c-a26a-3bcdc99faef6 admin admin] 10.222.0.39 "GET /v2.0/networks/ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c HTTP/1.1" status: 200 len: 886 time: 0.1343274 Dec 09 14:37:21.336551 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 50728) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:37:21.535196 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37603b7c-d2d1-489c-a8e3-095f67549a98 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:21.535550 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37603b7c-d2d1-489c-a8e3-095f67549a98 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:21.537134 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-37603b7c-d2d1-489c-a8e3-095f67549a98 admin admin] 10.222.0.39 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1992433 Dec 09 14:37:23.881748 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 50736) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:37:23.979873 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffea8db6-2e47-4bed-8b93-61150eaf3327 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:23.980237 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffea8db6-2e47-4bed-8b93-61150eaf3327 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:23.981757 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-ffea8db6-2e47-4bed-8b93-61150eaf3327 admin admin] 10.222.0.39 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.0990584 Dec 09 14:37:26.362867 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 50744) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:37:26.463002 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4d27915c-f64b-4782-9436-7cc6596cbf57 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:26.464419 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-4d27915c-f64b-4782-9436-7cc6596cbf57 admin admin] 10.222.0.39 "GET /v2.0/subnets/123b1636-37a5-4348-b751-3be9d23c5d7f HTTP/1.1" status: 200 len: 868 time: 0.1002204 Dec 09 14:37:26.951211 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-2d26df35-2c2b-450d-aa66-307829842a5d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:28.810792 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 50752) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:37:28.903019 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-321598f2-7c51-48c9-b703-de0d816e8d00 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:28.904374 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-321598f2-7c51-48c9-b703-de0d816e8d00 admin admin] 10.222.0.39 "GET /v2.0/subnets/e694bbf8-2176-4a1d-9b13-4712a7fb8309 HTTP/1.1" status: 200 len: 816 time: 0.0925748 Dec 09 14:37:29.167704 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-2750376c-3bc2-4bbe-80f7-e0eda530a758 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:30.366174 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:31.759059 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:32.611325 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:53.427242 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 5 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:37:53.652042 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50806) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:37:53.706334 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [None req-365db60e-4db0-49fb-aca5-09ac242243fa admin admin] http://10.222.0.39:9696/v2.0/extensions returned with HTTP 200 {{(pid=109062) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 14:37:53.707404 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-365db60e-4db0-49fb-aca5-09ac242243fa admin admin] 10.222.0.39 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0543406 Dec 09 14:37:56.189932 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50814) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:37:56.267501 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.pecan_wsgi.hooks.translation [None req-a7449728-384d-4667-b641-57825feda93e admin admin] GET failed (client error): The resource could not be found. Dec 09 14:37:56.269026 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-a7449728-384d-4667-b641-57825feda93e admin admin] 10.222.0.39 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0778325 Dec 09 14:37:56.355963 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d8bced17-41d2-4ec4-a70d-b2e9ac8c3e0e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:56.357393 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-d8bced17-41d2-4ec4-a70d-b2e9ac8c3e0e admin admin] 10.222.0.39 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.0835929 Dec 09 14:37:56.955192 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-6990b3dc-40f2-4ad9-84b0-8272c869b836 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:58.767289 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50822) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:37:58.821008 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Request body: {'network': {'admin_state_up': True, 'shared': True, 'name': 'shared'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:37:58.845308 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Made reservation on behalf of 500bcf2a09804a81b7cadce780546297 for: {'network': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:37:58.847510 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:58.875134 dv-cinder-819692-8-iscsi neutron-server[109062]: WARNING neutron.services.revisions.revision_plugin [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Could not find related network for resource to bump revision. Dec 09 14:37:58.885932 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 444} {{(pid=109062) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:37:58.894466 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:58.894834 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.segments_db [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Added segment f2938b2b-aa1e-4229-9424-41a0fb9d15c1 of type vlan for network 11abbada-ef44-4275-ad88-90374a31e950 Dec 09 14:37:58.931094 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:58.958079 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:58.959026 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:37:58.959634 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:37:59.011810 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.2429645 Dec 09 14:37:59.020327 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Pushing event updated for resources: {'Network': ['ID=11abbada-ef44-4275-ad88-90374a31e950,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:37:59.027501 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:59.027903 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:59.028252 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:59.028588 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:59.028922 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:59.029258 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:59.029586 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:59.029914 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:59.030240 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:59.030566 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:59.030934 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:59.031256 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:59.031576 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-50a014d9-5d08-470b-8a3e-977c9f64e10e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:37:59.045064 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network 11abbada-ef44-4275-ad88-90374a31e950 details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:37:59.164012 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-0fb8215c-7119-4a63-a80f-2701ab947a2e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:00.367398 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:01.401032 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 50830) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:38:01.469941 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.pecan_wsgi.hooks.translation [None req-0860fd49-2019-4f5f-b69c-e70c008dcea5 admin admin] GET failed (client error): The resource could not be found. Dec 09 14:38:01.471235 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-0860fd49-2019-4f5f-b69c-e70c008dcea5 admin admin] 10.222.0.39 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0692275 Dec 09 14:38:01.574082 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1622b102-b6cf-439a-b0c8-db7d41a02a6e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:38:01.575869 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-1622b102-b6cf-439a-b0c8-db7d41a02a6e admin admin] 10.222.0.39 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0998349 Dec 09 14:38:01.588980 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-4204e1c3-0c2c-40f7-98d7-947f6fe85cef admin admin] Request body: {'subnet': {'cidr': '192.168.233.0/24', 'ip_version': 4, 'description': 'shared-subnet', 'name': 'shared-subnet', 'network_id': '11abbada-ef44-4275-ad88-90374a31e950'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:38:01.614520 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4204e1c3-0c2c-40f7-98d7-947f6fe85cef admin admin] Made reservation on behalf of 500bcf2a09804a81b7cadce780546297 for: {'subnet': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:38:01.616838 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4204e1c3-0c2c-40f7-98d7-947f6fe85cef admin admin] Publish callbacks [] for subnet, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:01.755097 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:01.787115 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4204e1c3-0c2c-40f7-98d7-947f6fe85cef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for subnet, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:01.843377 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4204e1c3-0c2c-40f7-98d7-947f6fe85cef admin admin] Pushing event updated for resources: {'Subnet': ['ID=5861390c-9e39-46da-9b62-598ef23384d8,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:38:01.852422 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4204e1c3-0c2c-40f7-98d7-947f6fe85cef admin admin] Checking segment: {'id': 'f2938b2b-aa1e-4229-9424-41a0fb9d15c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': '11abbada-ef44-4275-ad88-90374a31e950'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:38:01.852781 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4204e1c3-0c2c-40f7-98d7-947f6fe85cef admin admin] Network hostable DHCP agents. Network: 11abbada-ef44-4275-ad88-90374a31e950, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109061) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:38:01.870922 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4204e1c3-0c2c-40f7-98d7-947f6fe85cef admin admin] Network 11abbada-ef44-4275-ad88-90374a31e950 is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109061) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:38:01.881998 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-4204e1c3-0c2c-40f7-98d7-947f6fe85cef admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, 11abbada-ef44-4275-ad88-90374a31e950) {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:38:01.886282 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4204e1c3-0c2c-40f7-98d7-947f6fe85cef admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:38:01.886893 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4204e1c3-0c2c-40f7-98d7-947f6fe85cef admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:01.892021 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b1dbbd0-7b8b-42a2-a617-ee1a8d498a91 None None] Network 11abbada-ef44-4275-ad88-90374a31e950 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:38:01.903336 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-4204e1c3-0c2c-40f7-98d7-947f6fe85cef admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3202660 Dec 09 14:38:02.099121 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp191c2114-7e35-566a-a422-2a0bb50a5442-11abbada-ef44-4275-ad88-90374a31e950', 'network_id': '11abbada-ef44-4275-ad88-90374a31e950', 'project_id': '500bcf2a09804a81b7cadce780546297', 'fixed_ips': [{'subnet_id': '5861390c-9e39-46da-9b62-598ef23384d8'}]}} from dv-cinder-819692-8-iscsi. {{(pid=109063) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 14:38:02.100088 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:02.236080 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.db_base_plugin_common [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Allocated IP 192.168.233.2 (11abbada-ef44-4275-ad88-90374a31e950/5861390c-9e39-46da-9b62-598ef23384d8/dc48633f-b6e1-43fb-b365-e965eaa5a37b) {{(pid=109063) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:38:02.379316 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Publish callbacks [] for port, precommit_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:02.389526 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:02.431676 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Network 11abbada-ef44-4275-ad88-90374a31e950 is already hosted by enough agents. {{(pid=109063) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:38:02.434454 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.base_scheduler [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Resources bound (agent type, host, resource id): {{(pid=109063) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:38:02.439207 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Received port after_create {{(pid=109063) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:38:02.441062 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Pushing event updated for resources: {'Port': ['ID=dc48633f-b6e1-43fb-b365-e965eaa5a37b,revision_number=1']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:38:02.451545 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:38:02.451937 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:38:02.452300 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:38:02.452815 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:38:02.453154 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:38:02.453466 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:38:02.453796 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:38:02.454121 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:38:02.454453 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:38:02.454801 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:38:02.455128 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:38:02.455453 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:38:02.455793 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:38:02.504346 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Attempting to bind port dc48633f-b6e1-43fb-b365-e965eaa5a37b on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:38:02.504717 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Attempting to bind port dc48633f-b6e1-43fb-b365-e965eaa5a37b by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'f2938b2b-aa1e-4229-9424-41a0fb9d15c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': '11abbada-ef44-4275-ad88-90374a31e950'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:38:02.505080 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Attempting to bind port dc48633f-b6e1-43fb-b365-e965eaa5a37b on network 11abbada-ef44-4275-ad88-90374a31e950 {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:38:02.510033 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 37, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:38:02.510402 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Checking segment: {'id': 'f2938b2b-aa1e-4229-9424-41a0fb9d15c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': '11abbada-ef44-4275-ad88-90374a31e950'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:38:02.510799 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:02.511186 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Bound using segment: {'id': 'f2938b2b-aa1e-4229-9424-41a0fb9d15c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': '11abbada-ef44-4275-ad88-90374a31e950'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:38:02.511680 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Bound port: dc48633f-b6e1-43fb-b365-e965eaa5a37b, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f2938b2b-aa1e-4229-9424-41a0fb9d15c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': '11abbada-ef44-4275-ad88-90374a31e950'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:38:02.512075 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:02.574978 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] For port dc48633f-b6e1-43fb-b365-e965eaa5a37b, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:38:02.578168 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] For port dc48633f-b6e1-43fb-b365-e965eaa5a37b, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=dc48633f-b6e1-43fb-b365-e965eaa5a37b,segment=NetworkSegment(f2938b2b-aa1e-4229-9424-41a0fb9d15c1),segment_id=f2938b2b-aa1e-4229-9424-41a0fb9d15c1)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:38:02.583985 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:02.649931 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-349cf63b-b9d0-446f-b274-1bc3866dcc2a None None] Pushing event updated for resources: {'Port': ['ID=dc48633f-b6e1-43fb-b365-e965eaa5a37b,revision_number=2']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:38:02.666281 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:03.428803 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4506940-3698-4e8a-824f-f8aea693c1bc None None] Network 11abbada-ef44-4275-ad88-90374a31e950 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:38:03.502640 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-831a29c5-2ef6-464c-8991-6638bf92a001 None None] Provisioning complete for port dc48633f-b6e1-43fb-b365-e965eaa5a37b triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:38:03.503010 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-831a29c5-2ef6-464c-8991-6638bf92a001 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:03.617145 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-831a29c5-2ef6-464c-8991-6638bf92a001 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:03.655184 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-831a29c5-2ef6-464c-8991-6638bf92a001 None None] For port dc48633f-b6e1-43fb-b365-e965eaa5a37b, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=dc48633f-b6e1-43fb-b365-e965eaa5a37b,segment=NetworkSegment(f2938b2b-aa1e-4229-9424-41a0fb9d15c1),segment_id=f2938b2b-aa1e-4229-9424-41a0fb9d15c1)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:38:03.661337 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-831a29c5-2ef6-464c-8991-6638bf92a001 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:03.727352 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-831a29c5-2ef6-464c-8991-6638bf92a001 None None] Pushing event updated for resources: {'Port': ['ID=dc48633f-b6e1-43fb-b365-e965eaa5a37b,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:38:03.884880 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-7d39751c-7aa8-44aa-8edc-d7baae079be0 None None] Provisioning complete for port dc48633f-b6e1-43fb-b365-e965eaa5a37b triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:38:03.885124 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-7d39751c-7aa8-44aa-8edc-d7baae079be0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:04.551848 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device dc48633f-b6e1-43fb-b365-e965eaa5a37b up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:38:04.603555 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port dc48633f-b6e1-43fb-b365-e965eaa5a37b triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:38:04.603957 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:26.960052 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-e7adbeb2-f3c6-44b0-98b8-55fcf94d0314 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:29.158530 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-dff0d6aa-a1d9-49e6-a2a1-d6726555bc80 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:30.371793 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:30.426169 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 5 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:38:31.758958 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:32.605466 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:56.965290 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-292bc559-b184-4978-81b8-49b1fc1a5293 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:38:59.169775 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-903f63af-ffd1-4dd4-b9b9-2dd705c98ba2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:00.375327 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:01.763011 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:02.614139 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:07.425433 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 5 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:39:13.738429 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50876) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:39:13.744874 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [None req-dcc2c5dc-3863-4b63-afa4-786960252f1c tempest-verify_tempest_config-2125748375 tempest-verify_tempest_config-2125748375-project] http://10.222.0.39:9696/v2.0/extensions returned with HTTP 200 {{(pid=109062) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 14:39:13.745928 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-dcc2c5dc-3863-4b63-afa4-786960252f1c tempest-verify_tempest_config-2125748375 tempest-verify_tempest_config-2125748375-project] 10.222.0.39 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0064960 Dec 09 14:39:14.053575 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50894) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:39:14.166145 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:14.243494 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:14.249923 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:14.301614 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19db821f-aee1-40c5-9186-68c2fee6bff4,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:39:14.305199 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=ec8ff373f40f431781a0b4f1057ad367&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2506149 Dec 09 14:39:14.308260 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 50898) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:39:14.310574 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.310938 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.311290 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.311660 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.312016 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.312345 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.312677 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.313004 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.313342 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.313683 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.314008 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.314297 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.314616 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5de0a078-dafd-455b-a1fe-6f7aa490e7a7 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.392485 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:14.417869 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:14.518359 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:14.521703 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:14.523217 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/19db821f-aee1-40c5-9186-68c2fee6bff4 HTTP/1.1" status: 204 len: 168 time: 0.2139499 Dec 09 14:39:14.531187 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19db821f-aee1-40c5-9186-68c2fee6bff4,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:39:14.538050 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.538442 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.538787 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.539135 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.539472 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.539842 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.540194 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.540527 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.540863 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.541212 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.541544 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.541872 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:14.542307 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33cb3666-4ba5-44bc-888e-25d1a1e75017 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:39:26.970490 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3e8eba52-d739-4ae4-b034-5b0e8c9a81c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:29.170155 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-a1b5fc72-5d8f-421d-bd9b-0acbcecc67c5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:30.383421 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:31.766162 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:32.609031 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:44.428745 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 5 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:39:56.980832 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f2a1dfa4-8e8f-41d7-81ce-0d5e15f844e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:39:59.172850 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-2533aa50-05a5-4ff4-88c6-45c7aeeaf0ef None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:40:00.384666 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:40:01.769666 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:40:02.623350 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:40:21.433210 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 5 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:40:26.986924 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-2a9b3fc7-e184-4c92-8cba-573c81be68d9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:40:29.170735 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-73c4a74e-bd9a-4487-892b-6b7e1e09dd40 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:40:30.392879 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:40:31.775743 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:40:32.620951 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:40:44.279807 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1627840'] for agent, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:40:56.985099 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-982b8343-b2cf-45cb-af02-6d266864c1e0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:40:58.433001 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:40:59.166484 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-912f5c55-805a-4e99-b317-b0abb3e628b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:41:00.384677 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50974) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:41:00.389047 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:41:00.493544 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-5ef2dc8e-c7b3-4d1e-8ae3-91ad2596fe70 admin admin] 10.222.0.39 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1077185 Dec 09 14:41:01.775424 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:41:02.614209 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:41:02.847061 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 50984) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:41:02.913515 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-95a6d925-fd6d-4b3d-85a7-1c96cdc5b24a admin admin] 10.222.0.39 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0654075 Dec 09 14:41:14.255720 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:41:26.979056 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-84a2cba7-2aff-4565-9514-82554c26a89b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:41:29.170498 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-195310de-c90d-4a1d-94e5-745442eb5c27 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:41:30.397951 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:41:31.778136 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:41:32.624119 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:41:35.432271 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:41:44.273902 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:41:56.973766 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f895e6df-4389-4c95-8cc1-33330a71e71f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:41:59.166483 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-c49f2d96-bade-4a4a-b449-7a43843e941b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:00.398807 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:01.780076 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:02.620337 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:12.431528 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:42:14.295355 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:26.978812 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5a80fc88-0228-4720-8227-39b103de8355 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:29.168247 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-b8ebd48b-dcc5-430a-afa5-1a8edd978dd3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:30.418879 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:31.787334 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:31.973838 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51164) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:32.152157 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-360714841-network', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:32.178854 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Made reservation on behalf of 6be5d78d2d0049448c3947b4e650758a for: {'network': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:32.182033 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:32.197492 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:32.214190 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51192) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:32.279994 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:32.285778 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:32.311438 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 412} {{(pid=109061) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:42:32.331005 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8747843008705', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:32.332009 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Unsubscribe: segment precommit_create {{(pid=109061) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Dec 09 14:42:32.332663 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.segments_db [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Added segment 1adee164-28a6-4213-83dc-d46a3aca10ed of type vlan for network 9ab3f8b6-44d0-4210-907d-0e96072c4566 Dec 09 14:42:32.347579 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=84982077-48d6-4c41-b24d-f6a4e065606c,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:32.385268 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.385642 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Tracked resource versions report: Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: pushed versions: Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: { 'AddressGroup': {'1.2'}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'ConntrackHelper': {'1.0'}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'LocalIPAssociation': {'1.0'}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Log': {'1.0'}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Network': {'1.1'}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Port': {'1.7'}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'PortForwarding': {'1.2'}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'QosPolicy': {'1.10'}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'SecurityGroup': {'1.5'}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'SecurityGroupRule': {'1.2'}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'SubPort': {'1.0'}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Subnet': {'1.1'}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Trunk': {'1.1'}} Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: consumer versions: Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: { DHCP agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: HyperV agent@hv-cinder-81969: {}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: L3 agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: Metadata agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: Metering agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: Open vSwitch agent@dv-cinder-819692-8-iscsi: { 'AddressGroup': '1.2', Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'ConntrackHelper': '1.0', Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'LocalIPAssociation': '1.0', Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Log': '1.0', Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Network': '1.1', Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Port': '1.7', Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'PortForwarding': '1.2', Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'QosPolicy': '1.10', Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'SecurityGroup': '1.5', Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'SecurityGroupRule': '1.2', Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'SubPort': '1.0', Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Subnet': '1.1', Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: 'Trunk': '1.1'}} Dec 09 14:42:32.397726 dv-cinder-819692-8-iscsi neutron-server[109061]: {{(pid=109061) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 14:42:32.400535 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:32.430108 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:32.431080 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:32.431756 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:32.493360 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.5169537 Dec 09 14:42:32.496801 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51210) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:32.505815 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Request body: {'subnet': {'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-subnet', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:32.529920 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5be32156-a7c8-4b80-9899-49de3af0120b admin admin] Pushing event updated for resources: {'Network': ['ID=9ab3f8b6-44d0-4210-907d-0e96072c4566,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:32.536314 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Made reservation on behalf of 6be5d78d2d0049448c3947b4e650758a for: {'subnet': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:32.538838 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Publish callbacks [] for subnet, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:32.543113 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network 9ab3f8b6-44d0-4210-907d-0e96072c4566 details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:42:32.645438 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:32.670531 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51216) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:32.748646 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-124133172-network', 'tenant_id': '1c1fb4e2e42c41e6bfff5cb72fe05656'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:32.771444 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51220) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:32.781568 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] Made reservation on behalf of 1c1fb4e2e42c41e6bfff5cb72fe05656 for: {'network': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:32.783871 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:32.797670 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:32.807265 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for subnet, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:32.862741 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51226) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:32.891361 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Pushing event updated for resources: {'Subnet': ['ID=f10f1097-5d43-4737-bcac-a27ade66b442,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:32.916827 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.917441 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.917979 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.918464 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.919061 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.920014 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.920830 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.921657 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.922245 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.922778 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.923403 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.923952 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.924437 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Tracked resource versions report: Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: pushed versions: Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: { 'AddressGroup': {'1.2'}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'ConntrackHelper': {'1.0'}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'LocalIPAssociation': {'1.0'}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Log': {'1.0'}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Network': {'1.1'}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Port': {'1.7'}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'PortForwarding': {'1.2'}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'QosPolicy': {'1.10'}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'SecurityGroup': {'1.5'}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'SecurityGroupRule': {'1.2'}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'SubPort': {'1.0'}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Subnet': {'1.1'}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Trunk': {'1.1'}} Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: consumer versions: Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: { DHCP agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: HyperV agent@hv-cinder-81969: {}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: L3 agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: Metadata agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: Metering agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: Open vSwitch agent@dv-cinder-819692-8-iscsi: { 'AddressGroup': '1.2', Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'ConntrackHelper': '1.0', Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'LocalIPAssociation': '1.0', Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Log': '1.0', Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Network': '1.1', Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Port': '1.7', Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'PortForwarding': '1.2', Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'QosPolicy': '1.10', Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'SecurityGroup': '1.5', Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'SecurityGroupRule': '1.2', Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'SubPort': '1.0', Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Subnet': '1.1', Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: 'Trunk': '1.1'}} Dec 09 14:42:32.925960 dv-cinder-819692-8-iscsi neutron-server[109062]: {{(pid=109062) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 14:42:32.939552 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-257021972-network', 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:32.949543 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Checking segment: {'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109062) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:32.949943 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Network hostable DHCP agents. Network: 9ab3f8b6-44d0-4210-907d-0e96072c4566, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109062) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:42:32.979631 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] Made reservation on behalf of 3d298e3ebec54c2281ddf8bbb50b7cea for: {'network': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:32.982237 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:32.999459 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Network 9ab3f8b6-44d0-4210-907d-0e96072c4566 is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109062) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:42:33.000507 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.025995 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.026219 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-806346136-network', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:33.028611 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, 9ab3f8b6-44d0-4210-907d-0e96072c4566) {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:33.036295 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:33.037491 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.038735 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-07c0eafc-acc0-48bc-b38d-da501e4d4bf9 None None] Network 9ab3f8b6-44d0-4210-907d-0e96072c4566 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:42:33.042910 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.073322 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-e137645e-1283-415c-9104-c4a879fc3267 admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.5753555 Dec 09 14:42:33.085028 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51240) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:33.090971 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:33.105547 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] Made reservation on behalf of a538bf01cb5440ffa06b6873f212efaa for: {'network': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:33.107958 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 400} {{(pid=109062) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:42:33.110844 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.136957 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.138786 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.segments_db [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] Added segment 2cc4f8a7-4cb6-4253-83d3-39c4929772e8 of type vlan for network 51590e0b-46a5-4e2e-8094-5ee83cac94b5 Dec 09 14:42:33.141813 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1966312942-network', 'tenant_id': '5ec989b7fd3e45f2b8962e012b0797ac'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:33.148156 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.210330 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e3b44b4-3206-4554-9176-89efc3ce4a3a,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:33.261804 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp191c2114-7e35-566a-a422-2a0bb50a5442-9ab3f8b6-44d0-4210-907d-0e96072c4566', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442'}]}} from dv-cinder-819692-8-iscsi. {{(pid=109063) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 14:42:33.262723 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.268538 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1626853', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30590'] for router, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.270862 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1626745', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1584168', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1653733', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30569'] for router, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.283130 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.295912 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.369391 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] Made reservation on behalf of 5ec989b7fd3e45f2b8962e012b0797ac for: {'network': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:33.372751 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.384433 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.392604 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.469541 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.481256 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.482758 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:33.483363 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.512501 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d3151d2-417f-4569-9d44-49489aa9418d,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:33.551200 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 425} {{(pid=109061) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:42:33.557554 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.577601 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.3595624 Dec 09 14:42:33.577943 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.587480 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51266) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:33.644962 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.db_base_plugin_common [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Allocated IP 172.20.0.2 (9ab3f8b6-44d0-4210-907d-0e96072c4566/f10f1097-5d43-4737-bcac-a27ade66b442/ee4e8552-9104-4bc3-a43c-493419d282a1) {{(pid=109063) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:42:33.677250 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-f5f569e7-cf48-4ab7-bf45-146e1cf9074f admin admin] Request body: {'subnet': {'network_id': '51590e0b-46a5-4e2e-8094-5ee83cac94b5', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-124133172-subnet', 'tenant_id': '1c1fb4e2e42c41e6bfff5cb72fe05656', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:33.689721 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8fcac96f-cc33-4e38-a206-df35f6e6373e,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:33.730262 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85431187-1c1c-4546-b33c-a74cdec083c9 admin admin] Pushing event updated for resources: {'Network': ['ID=51590e0b-46a5-4e2e-8094-5ee83cac94b5,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:33.750939 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.751284 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.segments_db [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] Added segment 7ece4ded-a169-4d54-b911-54a5a65cd0ce of type vlan for network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 Dec 09 14:42:33.779965 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 405} {{(pid=109061) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:42:33.827523 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network 51590e0b-46a5-4e2e-8094-5ee83cac94b5 details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:42:33.835083 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.852651 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.853703 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.854052 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.segments_db [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] Added segment f11d9e19-2d99-4f20-a186-cdaeddb729de of type vlan for network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d Dec 09 14:42:33.855353 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.869798 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 442} {{(pid=109061) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:42:33.880158 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.880603 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.segments_db [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] Added segment 249aca58-f120-4349-ac3d-e3bc6b709d78 of type vlan for network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b Dec 09 14:42:33.922869 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.948797 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.953974 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Publish callbacks [] for port, precommit_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.966018 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.967001 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:33.967588 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:33.969632 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.076692 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Pushing event updated for resources: {'Port': ['ID=ee4e8552-9104-4bc3-a43c-493419d282a1,revision_number=1']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:34.112899 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:34.113515 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:34.114015 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:34.114516 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:34.115025 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:34.115508 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:34.116049 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:34.116543 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:34.117056 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:34.117568 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:34.118059 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:34.118533 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:34.119364 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Tracked resource versions report: Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: pushed versions: Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: { 'AddressGroup': {'1.2'}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'ConntrackHelper': {'1.0'}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'LocalIPAssociation': {'1.0'}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Log': {'1.0'}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Network': {'1.1'}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Port': {'1.7'}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'PortForwarding': {'1.2'}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'QosPolicy': {'1.10'}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'SecurityGroup': {'1.5'}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'SecurityGroupRule': {'1.2'}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'SubPort': {'1.0'}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Subnet': {'1.1'}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Trunk': {'1.1'}} Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: consumer versions: Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: { DHCP agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: HyperV agent@hv-cinder-81969: {}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: L3 agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: Metadata agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: Metering agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: Open vSwitch agent@dv-cinder-819692-8-iscsi: { 'AddressGroup': '1.2', Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'ConntrackHelper': '1.0', Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'LocalIPAssociation': '1.0', Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Log': '1.0', Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Network': '1.1', Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Port': '1.7', Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'PortForwarding': '1.2', Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'QosPolicy': '1.10', Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'SecurityGroup': '1.5', Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'SecurityGroupRule': '1.2', Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'SubPort': '1.0', Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Subnet': '1.1', Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: 'Trunk': '1.1'}} Dec 09 14:42:34.121257 dv-cinder-819692-8-iscsi neutron-server[109063]: {{(pid=109063) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 14:42:34.137542 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Network 9ab3f8b6-44d0-4210-907d-0e96072c4566 is already hosted by enough agents. {{(pid=109063) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:42:34.143816 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.base_scheduler [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Resources bound (agent type, host, resource id): {{(pid=109063) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:34.147816 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Received port after_create {{(pid=109063) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:42:34.148304 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] Pushing event updated for resources: {'Network': ['ID=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:34.161780 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:42:34.172805 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f5f569e7-cf48-4ab7-bf45-146e1cf9074f admin admin] Made reservation on behalf of 1c1fb4e2e42c41e6bfff5cb72fe05656 for: {'subnet': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:34.176090 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f5f569e7-cf48-4ab7-bf45-146e1cf9074f admin admin] Publish callbacks [] for subnet, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.179553 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.207211 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.262026 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.db.resource_extend [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] It took 0.30 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 14:42:34.276611 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 1.5037553 Dec 09 14:42:34.287048 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51310) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:34.293842 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-289efcc0-d542-4775-9acf-571295997c2e admin admin] Request body: {'subnet': {'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-806346136-subnet', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:34.308139 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.325053 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Attempting to bind port ee4e8552-9104-4bc3-a43c-493419d282a1 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:42:34.325761 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Attempting to bind port ee4e8552-9104-4bc3-a43c-493419d282a1 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:42:34.326355 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Attempting to bind port ee4e8552-9104-4bc3-a43c-493419d282a1 on network 9ab3f8b6-44d0-4210-907d-0e96072c4566 {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:42:34.328783 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d76c721b-af8f-48b5-be38-2e66f12d4ca5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=01637d6a-d569-45c3-9f77-09d5026bf53c,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:34.333530 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 42, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:42:34.334247 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Checking segment: {'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:34.334933 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.335544 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Bound using segment: {'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:42:34.336301 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Bound port: ee4e8552-9104-4bc3-a43c-493419d282a1, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:42:34.336978 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.355137 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.356290 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:34.356803 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.370841 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-289efcc0-d542-4775-9acf-571295997c2e admin admin] Made reservation on behalf of a538bf01cb5440ffa06b6873f212efaa for: {'subnet': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:34.374016 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-289efcc0-d542-4775-9acf-571295997c2e admin admin] Publish callbacks [] for subnet, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.452239 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] Pushing event updated for resources: {'Network': ['ID=8ff38a1e-5122-4806-8b7d-d4c281cbe550,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:34.454241 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] For port ee4e8552-9104-4bc3-a43c-493419d282a1, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:42:34.458070 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] For port ee4e8552-9104-4bc3-a43c-493419d282a1, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=ee4e8552-9104-4bc3-a43c-493419d282a1,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:42:34.475033 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:42:34.477712 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.480441 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:34.480441 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.508485 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-8e13b5ab-d671-4553-b6c0-31cdca784699 admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 891 time: 1.8365803 Dec 09 14:42:34.510649 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.518407 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51330) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:34.533088 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-cadf798e-c93f-41e5-8c7f-32738dc5f7e9 admin admin] Request body: {'subnet': {'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-257021972-subnet', 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:34.608215 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cadf798e-c93f-41e5-8c7f-32738dc5f7e9 admin admin] Made reservation on behalf of 3d298e3ebec54c2281ddf8bbb50b7cea for: {'subnet': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:34.610701 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cadf798e-c93f-41e5-8c7f-32738dc5f7e9 admin admin] Publish callbacks [] for subnet, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.717357 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 1.8533528 Dec 09 14:42:34.717507 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Allocated IP 172.27.0.19 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/1a62fbb4-9280-496c-b60d-bf0b4423d01c) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:42:34.721072 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51334) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:34.729763 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-c20a2e2e-742d-4f3d-9dbc-0fffab834b60 admin admin] Request body: {'subnet': {'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1966312942-subnet', 'tenant_id': '5ec989b7fd3e45f2b8962e012b0797ac', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:34.740625 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-289efcc0-d542-4775-9acf-571295997c2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for subnet, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.763018 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1470a935-2fa8-446d-8703-c90f781dff91 None None] Pushing event updated for resources: {'Port': ['ID=ee4e8552-9104-4bc3-a43c-493419d282a1,revision_number=2']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:34.768345 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54d49fe3-316c-4173-9caf-5542144f459f admin admin] Pushing event updated for resources: {'Network': ['ID=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:34.796741 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:42:34.864505 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c20a2e2e-742d-4f3d-9dbc-0fffab834b60 admin admin] Made reservation on behalf of 5ec989b7fd3e45f2b8962e012b0797ac for: {'subnet': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:34.866841 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c20a2e2e-742d-4f3d-9dbc-0fffab834b60 admin admin] Publish callbacks [] for subnet, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:34.978763 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-289efcc0-d542-4775-9acf-571295997c2e admin admin] Pushing event updated for resources: {'Subnet': ['ID=4b7e026c-4454-4200-91c3-30d27a976452,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:34.995745 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-289efcc0-d542-4775-9acf-571295997c2e admin admin] Checking segment: {'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109062) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:34.996109 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-289efcc0-d542-4775-9acf-571295997c2e admin admin] Network hostable DHCP agents. Network: 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109062) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:42:35.092290 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.092644 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f5f569e7-cf48-4ab7-bf45-146e1cf9074f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for subnet, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.097752 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-289efcc0-d542-4775-9acf-571295997c2e admin admin] Network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109062) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:42:35.125773 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51352) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:35.167806 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5f569e7-cf48-4ab7-bf45-146e1cf9074f admin admin] Pushing event updated for resources: {'Subnet': ['ID=ae0e8ccb-a0a9-4f5b-93f6-77fb4806d03e,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:35.198597 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51358) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:35.258823 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f5f569e7-cf48-4ab7-bf45-146e1cf9074f admin admin] Checking segment: {'id': '2cc4f8a7-4cb6-4253-83d3-39c4929772e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '51590e0b-46a5-4e2e-8094-5ee83cac94b5'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:35.259099 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5f569e7-cf48-4ab7-bf45-146e1cf9074f admin admin] Network hostable DHCP agents. Network: 51590e0b-46a5-4e2e-8094-5ee83cac94b5, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109061) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:42:35.263022 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-289efcc0-d542-4775-9acf-571295997c2e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b) {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:35.284217 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4808e8b9-0de3-4303-a82d-b12e8e7d3cb5 None None] Network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:42:35.305956 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cadf798e-c93f-41e5-8c7f-32738dc5f7e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for subnet, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.343748 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-289efcc0-d542-4775-9acf-571295997c2e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:35.344361 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-289efcc0-d542-4775-9acf-571295997c2e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.355865 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f5f569e7-cf48-4ab7-bf45-146e1cf9074f admin admin] Network 51590e0b-46a5-4e2e-8094-5ee83cac94b5 is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109061) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:42:35.388448 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-f5f569e7-cf48-4ab7-bf45-146e1cf9074f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, 51590e0b-46a5-4e2e-8094-5ee83cac94b5) {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:35.390367 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2cc003e7-343f-4560-99dc-ade99d4351c8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.400230 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f5f569e7-cf48-4ab7-bf45-146e1cf9074f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:35.400969 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f5f569e7-cf48-4ab7-bf45-146e1cf9074f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.415123 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e542aa82-c8cd-4976-86a3-34447070bfdf None None] Network 51590e0b-46a5-4e2e-8094-5ee83cac94b5 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:42:35.426262 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.452815 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cadf798e-c93f-41e5-8c7f-32738dc5f7e9 admin admin] Pushing event updated for resources: {'Subnet': ['ID=90388423-2d07-4cbe-80d8-fa2f6a3c14f7,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:35.474787 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-f5f569e7-cf48-4ab7-bf45-146e1cf9074f admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.8163180 Dec 09 14:42:35.478590 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ed6062d1-6b0b-4e5a-931d-dcff5a978f3b admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.484204 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cadf798e-c93f-41e5-8c7f-32738dc5f7e9 admin admin] Checking segment: {'id': '7ece4ded-a169-4d54-b911-54a5a65cd0ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:35.484784 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cadf798e-c93f-41e5-8c7f-32738dc5f7e9 admin admin] Network hostable DHCP agents. Network: 8ff38a1e-5122-4806-8b7d-d4c281cbe550, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109061) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:42:35.524641 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:42:35.526192 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c20a2e2e-742d-4f3d-9dbc-0fffab834b60 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for subnet, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.534994 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Pushing event updated for resources: {'Port': ['ID=1a62fbb4-9280-496c-b60d-bf0b4423d01c,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:35.540711 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:35.548085 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cadf798e-c93f-41e5-8c7f-32738dc5f7e9 admin admin] Network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109061) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:42:35.549437 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:42:35.595782 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-cadf798e-c93f-41e5-8c7f-32738dc5f7e9 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, 8ff38a1e-5122-4806-8b7d-d4c281cbe550) {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:35.597102 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp191c2114-7e35-566a-a422-2a0bb50a5442-1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452'}]}} from dv-cinder-819692-8-iscsi. {{(pid=109063) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 14:42:35.598204 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.607876 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cadf798e-c93f-41e5-8c7f-32738dc5f7e9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:35.608485 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cadf798e-c93f-41e5-8c7f-32738dc5f7e9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.610670 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d50bcb15-fe97-4b57-995c-65b51f949970 None None] Network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:42:35.616636 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2cc003e7-343f-4560-99dc-ade99d4351c8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.626951 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2cc003e7-343f-4560-99dc-ade99d4351c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.687662 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-cadf798e-c93f-41e5-8c7f-32738dc5f7e9 admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 855 time: 1.1478028 Dec 09 14:42:35.687937 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21f6b11e-2517-4c20-8bd0-dffaa2e10f70 None None] Network 51590e0b-46a5-4e2e-8094-5ee83cac94b5 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:42:35.698157 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51378) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:35.712203 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-257021972-router', 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:35.749438 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-2cc003e7-343f-4560-99dc-ade99d4351c8 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=7663289ed92e42d8b97dac2abdcead93&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6197000 Dec 09 14:42:35.749654 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-289efcc0-d542-4775-9acf-571295997c2e admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.4609442 Dec 09 14:42:35.750554 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51386) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:35.751035 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51388) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:35.760358 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2cc003e7-343f-4560-99dc-ade99d4351c8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=12c219fa-b633-4b65-8cb8-0bfab46fa88e,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:35.779924 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ed6062d1-6b0b-4e5a-931d-dcff5a978f3b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.784417 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:35.814736 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ed6062d1-6b0b-4e5a-931d-dcff5a978f3b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.856060 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.db.api [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 09 14:42:35.856060 dv-cinder-819692-8-iscsi neutron-server[109061]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Dec 09 14:42:35.856060 dv-cinder-819692-8-iscsi neutron-server[109061]: [parameters: {'project_id_1': 'a538bf01cb5440ffa06b6873f212efaa', 'expiration_1': datetime.datetime(2021, 12, 9, 14, 42, 15, 793318)}] Dec 09 14:42:35.856060 dv-cinder-819692-8-iscsi neutron-server[109061]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=109061) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 14:42:35.856946 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG oslo_db.api [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 14:42:35.863988 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c20a2e2e-742d-4f3d-9dbc-0fffab834b60 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7c6b4bb0-bfec-44d0-8503-70917540b3c5,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:35.887889 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c20a2e2e-742d-4f3d-9dbc-0fffab834b60 admin admin] Checking segment: {'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109062) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:35.888395 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c20a2e2e-742d-4f3d-9dbc-0fffab834b60 admin admin] Network hostable DHCP agents. Network: 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109062) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:42:35.907556 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1626853', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30590'] for router, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.909258 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1626745', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1584168', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1653733', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30569'] for router, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:35.920165 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-ed6062d1-6b0b-4e5a-931d-dcff5a978f3b admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=9f39b9a406a44f819991482d0f4f25e8&name=default HTTP/1.1" status: 200 len: 2992 time: 0.7176912 Dec 09 14:42:35.923386 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed6062d1-6b0b-4e5a-931d-dcff5a978f3b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81e8acd9-b78c-47e9-9b92-f37172f5124f,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:35.926305 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51392) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:36.010430 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c20a2e2e-742d-4f3d-9dbc-0fffab834b60 admin admin] Network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109062) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:42:36.029114 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1e30b7b9-9758-443f-be2e-a4c383584e47 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.058271 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1e30b7b9-9758-443f-be2e-a4c383584e47 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.092659 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-c20a2e2e-742d-4f3d-9dbc-0fffab834b60 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d) {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:36.098451 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c20a2e2e-742d-4f3d-9dbc-0fffab834b60 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:36.098994 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c20a2e2e-742d-4f3d-9dbc-0fffab834b60 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.139665 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-c20a2e2e-742d-4f3d-9dbc-0fffab834b60 admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.4124269 Dec 09 14:42:36.139665 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.156536 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-12eeba7d-4f64-405d-8ec1-b37ea18b340d None None] Network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:42:36.161469 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.172109 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51410) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:36.176827 dv-cinder-819692-8-iscsi neutron-server[109061]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 09 14:42:36.276598 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd9266b7-faba-4e70-820d-a2ad54fb995b None None] Network 9ab3f8b6-44d0-4210-907d-0e96072c4566 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:42:36.278555 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3252853a-01ae-45a7-b060-b87889d2b6bd None None] Network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:42:36.438740 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d042ab2b-7c80-4a77-bf37-81d379f1d98e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.446848 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3d27068-ba87-4b6a-9d42-73be0fe8d060 None None] Network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:42:36.475885 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1626736', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1574391'] for router, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.478270 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.db_base_plugin_common [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Allocated IP 172.20.0.2 (1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b/4b7e026c-4454-4200-91c3-30d27a976452/c5033ada-1e97-420a-a22d-70c7b1b64073) {{(pid=109063) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:42:36.549592 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1e30b7b9-9758-443f-be2e-a4c383584e47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.552286 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1e30b7b9-9758-443f-be2e-a4c383584e47 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.555937 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-1e30b7b9-9758-443f-be2e-a4c383584e47 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/12c219fa-b633-4b65-8cb8-0bfab46fa88e HTTP/1.1" status: 204 len: 168 time: 0.7945740 Dec 09 14:42:36.588278 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d042ab2b-7c80-4a77-bf37-81d379f1d98e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.594047 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51442) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:36.597225 dv-cinder-819692-8-iscsi neutron-server[109062]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Dec 09 14:42:36.614972 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-de2b3e21-73f6-4b59-b080-c16c02c87d57 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:36.616554 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-de2b3e21-73f6-4b59-b080-c16c02c87d57 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/networks?id=51590e0b-46a5-4e2e-8094-5ee83cac94b5 HTTP/1.1" status: 200 len: 811 time: 0.4412363 Dec 09 14:42:36.620293 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.621133 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-280aefb8-4c6e-4505-98ca-101196636ee4 None None] Provisioning complete for port ee4e8552-9104-4bc3-a43c-493419d282a1 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:36.621715 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-280aefb8-4c6e-4505-98ca-101196636ee4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.629217 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e30b7b9-9758-443f-be2e-a4c383584e47 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=12c219fa-b633-4b65-8cb8-0bfab46fa88e,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:36.636975 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1626853', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30590'] for router, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.648076 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1626745', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1584168', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1653733', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30569'] for router, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.731651 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-14d75039-667f-4b13-aff7-d7675c2848b2 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/quotas/1c1fb4e2e42c41e6bfff5cb72fe05656 HTTP/1.1" status: 200 len: 375 time: 0.1039989 Dec 09 14:42:36.820193 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device ee4e8552-9104-4bc3-a43c-493419d282a1 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:42:36.863082 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-4161d061-dff0-4b37-9f70-c86ac5d9062d tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=1c1fb4e2e42c41e6bfff5cb72fe05656&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1235569 Dec 09 14:42:36.909217 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.916520 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ce9953-959c-498b-a239-cba26d7d473e req-6db28ba2-7cc4-4edb-b9df-cc0577c575a2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:36.917516 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d042ab2b-7c80-4a77-bf37-81d379f1d98e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.918664 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-6db28ba2-7cc4-4edb-b9df-cc0577c575a2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/networks?id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d HTTP/1.1" status: 200 len: 815 time: 0.3230095 Dec 09 14:42:36.920750 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d042ab2b-7c80-4a77-bf37-81d379f1d98e admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.922696 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-d042ab2b-7c80-4a77-bf37-81d379f1d98e admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/81e8acd9-b78c-47e9-9b92-f37172f5124f HTTP/1.1" status: 204 len: 168 time: 0.9936619 Dec 09 14:42:36.953217 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-280aefb8-4c6e-4505-98ca-101196636ee4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:36.956129 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-7cfec845-0818-4b2b-9aa5-977e64581a71 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/quotas/5ec989b7fd3e45f2b8962e012b0797ac HTTP/1.1" status: 200 len: 375 time: 0.0286863 Dec 09 14:42:37.000876 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-280aefb8-4c6e-4505-98ca-101196636ee4 None None] For port ee4e8552-9104-4bc3-a43c-493419d282a1, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=ee4e8552-9104-4bc3-a43c-493419d282a1,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:42:37.024458 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d042ab2b-7c80-4a77-bf37-81d379f1d98e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81e8acd9-b78c-47e9-9b92-f37172f5124f,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:37.029560 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-280aefb8-4c6e-4505-98ca-101196636ee4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:37.079863 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff is scheduled to L3 agent d9048829-2654-4d94-83cc-155a0884505e with binding_index 1 {{(pid=109062) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 14:42:37.083577 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-6e8f1ef8-fabe-4c12-913b-18e9ddf5c5b9 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=5ec989b7fd3e45f2b8962e012b0797ac&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1188869 Dec 09 14:42:37.167294 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:37.185028 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-280aefb8-4c6e-4505-98ca-101196636ee4 None None] Pushing event updated for resources: {'Port': ['ID=ee4e8552-9104-4bc3-a43c-493419d282a1,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:37.188071 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port ee4e8552-9104-4bc3-a43c-493419d282a1 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:37.188454 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:37.385719 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Publish callbacks [] for port, precommit_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:37.394309 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3567028c-8993-4b25-9d48-478a69ebe695 None None] Provisioning complete for port ee4e8552-9104-4bc3-a43c-493419d282a1 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:37.394998 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3567028c-8993-4b25-9d48-478a69ebe695 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:37.399063 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:37.408747 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:42:37.420381 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Sync routers for ids ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:42:37.434952 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] Publish callbacks [] for router, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:37.444856 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-e6a09fb2-a2ea-4cd0-83f7-e1b8945f0d45 admin admin] 10.222.0.39 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 4.3581650 Dec 09 14:42:37.446278 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51472) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:37.446910 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Routers {'49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:42:37.447547 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:42:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:37.463018 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b is already hosted by enough agents. {{(pid=109063) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:42:37.475485 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.base_scheduler [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Resources bound (agent type, host, resource id): {{(pid=109063) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:37.480819 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Received port after_create {{(pid=109063) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:42:37.496658 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Pushing event updated for resources: {'Port': ['ID=c5033ada-1e97-420a-a22d-70c7b1b64073,revision_number=1']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:37.563687 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Attempting to bind port c5033ada-1e97-420a-a22d-70c7b1b64073 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:42:37.564005 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Attempting to bind port c5033ada-1e97-420a-a22d-70c7b1b64073 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:42:37.564560 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Attempting to bind port c5033ada-1e97-420a-a22d-70c7b1b64073 on network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:42:37.604511 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 42, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:42:37.605655 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Checking segment: {'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:37.606379 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:37.607066 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Bound using segment: {'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:42:37.607755 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Bound port: c5033ada-1e97-420a-a22d-70c7b1b64073, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:42:37.608498 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:37.615483 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-f14d4942-34b4-44a6-a607-4e2a7b4c40b0 service neutron] http://10.222.0.39:9696/v2.0/extensions returned with HTTP 200 {{(pid=109061) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 14:42:37.616666 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-f14d4942-34b4-44a6-a607-4e2a7b4c40b0 service neutron] 10.222.0.39 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.4387650 Dec 09 14:42:37.780087 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51478) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:37.780333 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-60ccee52-256e-4477-b27b-674e2714c59d service neutron] http://10.222.0.39:9696/v2.0/extensions returned with HTTP 200 {{(pid=109062) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 14:42:37.781406 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-60ccee52-256e-4477-b27b-674e2714c59d service neutron] 10.222.0.39 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.4055569 Dec 09 14:42:37.783897 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] For port c5033ada-1e97-420a-a22d-70c7b1b64073, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:42:37.795436 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] For port c5033ada-1e97-420a-a22d-70c7b1b64073, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=c5033ada-1e97-420a-a22d-70c7b1b64073,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:42:37.808507 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:37.877315 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-749811af-d90a-4421-a18d-da060d9dcfa8 None None] Pushing event updated for resources: {'Port': ['ID=c5033ada-1e97-420a-a22d-70c7b1b64073,revision_number=2']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:37.887339 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Set router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:42:37.946092 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-65e55bc3-6457-4c90-8390-f9b195dab2fc admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.012806 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-68131939-dbfd-461d-b20b-0f4ff008d185 service neutron] 10.222.0.39 "GET /v2.0/networks/51590e0b-46a5-4e2e-8094-5ee83cac94b5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3827770 Dec 09 14:42:38.028252 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-b145cb06-7c02-426f-b0b6-7c3c450dd137 service neutron] 10.222.0.39 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1989098 Dec 09 14:42:38.152411 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:35Z', 'revision_number': 3, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:34Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:38.167769 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51484) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:38.173799 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.202152 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Checking router: 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:42:38.202642 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Updating router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff port 1a62fbb4-9280-496c-b60d-bf0b4423d01c binding host dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:42:38.235054 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.244879 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-cd8585c2-d888-4d96-9215-ac62489a7820 service neutron] 10.222.0.39 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1909783 Dec 09 14:42:38.277347 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.336615 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.374726 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1683422015-network', 'tenant_id': '27d5339e11934e85b3e5931f126faafa'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:38.424088 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-54b120e0-09ae-432b-865d-0f82c59e44de service neutron] 10.222.0.39 "GET /v2.0/networks/51590e0b-46a5-4e2e-8094-5ee83cac94b5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3800614 Dec 09 14:42:38.487443 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] Made reservation on behalf of 27d5339e11934e85b3e5931f126faafa for: {'network': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:38.490432 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.501189 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-65e55bc3-6457-4c90-8390-f9b195dab2fc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.505157 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.526675 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-65e55bc3-6457-4c90-8390-f9b195dab2fc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.533269 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.564799 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.618526 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-65e55bc3-6457-4c90-8390-f9b195dab2fc admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=3a8c997f1970488c92d70e92e6f41787&name=default HTTP/1.1" status: 200 len: 2992 time: 0.7816133 Dec 09 14:42:38.620194 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65e55bc3-6457-4c90-8390-f9b195dab2fc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ebe610c8-c144-4e37-961d-4121a0d82611,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:38.620825 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51496) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:38.734555 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Publish callbacks [] for port, precommit_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.760635 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.809898 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.882150 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Allocated IP 172.27.0.159 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/773a261e-796a-4ef7-b21d-e5fd6cad9fe8) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:42:38.911157 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device ee4e8552-9104-4bc3-a43c-493419d282a1 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:42:38.936950 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Attempting to bind port 1a62fbb4-9280-496c-b60d-bf0b4423d01c on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:42:38.939349 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Attempting to bind port 1a62fbb4-9280-496c-b60d-bf0b4423d01c by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:42:38.939956 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Attempting to bind port 1a62fbb4-9280-496c-b60d-bf0b4423d01c on network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:42:38.973208 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 42, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:42:38.976362 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Checking segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109064) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:38.978125 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.978981 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Bound using segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:42:38.980081 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Bound port: 1a62fbb4-9280-496c-b60d-bf0b4423d01c, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:42:38.981679 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:38.998029 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Pushing event updated for resources: {'Port': ['ID=1a62fbb4-9280-496c-b60d-bf0b4423d01c,revision_number=2']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:39.016621 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.019427 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2ac588d4-b140-4233-8168-662078eccc04 req-8f026704-7c5a-45fc-8626-e785f001b11a tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 210 time: 0.1263299 Dec 09 14:42:39.034204 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-45b695f7-db19-409d-9ace-9b2751c2c7af req-346bb60c-452c-411b-99b2-0e860576777b tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 210 time: 0.2951977 Dec 09 14:42:39.039507 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port ee4e8552-9104-4bc3-a43c-493419d282a1 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:39.040130 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.085176 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Allocated IP 172.20.0.1 (9ab3f8b6-44d0-4210-907d-0e96072c4566/f10f1097-5d43-4737-bcac-a27ade66b442/6db4124e-4bda-4bda-b604-9b9706732691) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:42:39.087173 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ba24202-40de-488c-8005-d78ee77bab66,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:39.110070 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 446} {{(pid=109062) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:42:39.115272 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:39.116128 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:39.116629 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:39.117129 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:39.117474 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:39.117812 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:39.118149 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:39.118498 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:39.119152 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:39.119503 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:39.119879 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:39.120206 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:39.120529 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Tracked resource versions report: Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: pushed versions: Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: { 'AddressGroup': {'1.2'}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'ConntrackHelper': {'1.0'}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'LocalIPAssociation': {'1.0'}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Log': {'1.0'}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Network': {'1.1'}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Port': {'1.7'}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'PortForwarding': {'1.2'}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'QosPolicy': {'1.10'}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'SecurityGroup': {'1.5'}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'SecurityGroupRule': {'1.2'}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'SubPort': {'1.0'}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Subnet': {'1.1'}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Trunk': {'1.1'}} Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: consumer versions: Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: { DHCP agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: HyperV agent@hv-cinder-81969: {}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: L3 agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: Metadata agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: Metering agent@dv-cinder-819692-8-iscsi: {}, Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: Open vSwitch agent@dv-cinder-819692-8-iscsi: { 'AddressGroup': '1.2', Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'ConntrackHelper': '1.0', Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'LocalIPAssociation': '1.0', Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Log': '1.0', Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Network': '1.1', Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Port': '1.7', Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'PortForwarding': '1.2', Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'QosPolicy': '1.10', Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'SecurityGroup': '1.5', Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'SecurityGroupRule': '1.2', Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'SubPort': '1.0', Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Subnet': '1.1', Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: 'Trunk': '1.1'}} Dec 09 14:42:39.121703 dv-cinder-819692-8-iscsi neutron-server[109064]: {{(pid=109064) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Dec 09 14:42:39.151780 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] For port 1a62fbb4-9280-496c-b60d-bf0b4423d01c, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109064) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:42:39.158341 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] For port 1a62fbb4-9280-496c-b60d-bf0b4423d01c, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=1a62fbb4-9280-496c-b60d-bf0b4423d01c,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109064) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:42:39.170025 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.170407 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-763421d5-b58b-4a73-a7c9-380a3dbda2bd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.194440 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.194849 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.segments_db [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] Added segment a84ec71a-f7fe-4f4f-adc5-96c2a8e50c39 of type vlan for network 943f3673-367c-4473-94d4-fc84cf80be4c Dec 09 14:42:39.238636 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device c5033ada-1e97-420a-a22d-70c7b1b64073 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:42:39.274534 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Routers {'49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:42:39.275190 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:42:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:39.280232 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.288754 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port c5033ada-1e97-420a-a22d-70c7b1b64073 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:39.289143 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.395125 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Allocated IP 172.27.0.107 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/46ee0f4b-ef18-440f-a266-611402454855) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:42:39.415937 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-763421d5-b58b-4a73-a7c9-380a3dbda2bd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.467497 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.482161 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.512770 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] Set router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:42:39.535665 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] For port c5033ada-1e97-420a-a22d-70c7b1b64073, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=c5033ada-1e97-420a-a22d-70c7b1b64073,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:42:39.538534 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-abd315f6-f80f-4b00-96db-f6d0ec788dee None None] Network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:42:39.552425 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.607895 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.610153 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.611915 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:39.612948 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.622313 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.664476 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.685968 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:42:39.695552 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:39.699389 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-763421d5-b58b-4a73-a7c9-380a3dbda2bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.713329 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:42:39.726245 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-763421d5-b58b-4a73-a7c9-380a3dbda2bd admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.732230 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-763421d5-b58b-4a73-a7c9-380a3dbda2bd admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/ebe610c8-c144-4e37-961d-4121a0d82611 HTTP/1.1" status: 204 len: 168 time: 1.1053276 Dec 09 14:42:39.778625 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-763421d5-b58b-4a73-a7c9-380a3dbda2bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ebe610c8-c144-4e37-961d-4121a0d82611,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:39.790298 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Pushing event updated for resources: {'Port': ['ID=773a261e-796a-4ef7-b21d-e5fd6cad9fe8,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:39.803388 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:42:39.808369 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 1.6372912 Dec 09 14:42:39.811310 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51554) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:39.825645 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-8459d9bf-ac4d-43d6-afed-01f0aff4a609 admin admin] Request body: {'subnet': {'network_id': '943f3673-367c-4473-94d4-fc84cf80be4c', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1683422015-subnet', 'tenant_id': '27d5339e11934e85b3e5931f126faafa', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:39.846894 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e982f671-89b0-4505-bf23-d83fe1864445 admin admin] Pushing event updated for resources: {'Network': ['ID=943f3673-367c-4473-94d4-fc84cf80be4c,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:39.859760 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.883738 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:39.932592 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58e7279e-b787-4e63-b012-f66a61e34bbc None None] Pushing event updated for resources: {'Port': ['ID=1a62fbb4-9280-496c-b60d-bf0b4423d01c,revision_number=3']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:39.934340 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:39.939476 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Pushing event updated for resources: {'Port': ['ID=6db4124e-4bda-4bda-b604-9b9706732691,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:39.942729 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:42:39.977661 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Network 9ab3f8b6-44d0-4210-907d-0e96072c4566 is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:42:39.979130 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:39.981607 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:42:39.982094 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1574184'] for router_interface, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:40.061201 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:35Z', 'revision_number': 3, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:40.129954 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8459d9bf-ac4d-43d6-afed-01f0aff4a609 admin admin] Made reservation on behalf of 27d5339e11934e85b3e5931f126faafa for: {'subnet': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:40.132546 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8459d9bf-ac4d-43d6-afed-01f0aff4a609 admin admin] Publish callbacks [] for subnet, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:40.159374 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Pushing event updated for resources: {'Port': ['ID=46ee0f4b-ef18-440f-a266-611402454855,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:40.173262 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cbbc2f93-8846-4361-bd2d-ddf9f4310bfa None None] The sync data for ids ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'] in dv-cinder-819692-8-iscsi is: [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:35Z', 'revision_number': 3, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:42:40.393554 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-21601b33-54bd-407b-b837-29e42e231042 req-4b14552f-5311-4dc2-b65e-b13704295847 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 210 time: 0.1553063 Dec 09 14:42:40.398427 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network 943f3673-367c-4473-94d4-fc84cf80be4c details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:42:40.635224 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d2fcbe1c-9706-4eeb-a4bf-bd816c39a1ff req-9c7ad617-8543-4809-9ceb-ff3109d6d6b9 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 210 time: 0.1762695 Dec 09 14:42:40.655339 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-cf2256b4-7fa1-4563-a63c-8c66e97d992a None None] Provisioning complete for port c5033ada-1e97-420a-a22d-70c7b1b64073 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:40.655709 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-cf2256b4-7fa1-4563-a63c-8c66e97d992a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:40.657802 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:40.809950 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Pushing event updated for resources: {'Port': ['ID=c5033ada-1e97-420a-a22d-70c7b1b64073,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:41.076330 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-720b322d-2a86-4658-bc8c-cd089ad6b1c0 None None] Provisioning complete for port 6db4124e-4bda-4bda-b604-9b9706732691 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:41.076711 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-720b322d-2a86-4658-bc8c-cd089ad6b1c0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:41.187704 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:41.197409 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-720b322d-2a86-4658-bc8c-cd089ad6b1c0 None None] Port 6db4124e-4bda-4bda-b604-9b9706732691 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:42:41.285680 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:41.337672 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-7c3dee90-772b-4b9b-97b1-2f698e6dcbb5 None None] Provisioning complete for port c5033ada-1e97-420a-a22d-70c7b1b64073 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:41.339159 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-7c3dee90-772b-4b9b-97b1-2f698e6dcbb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:41.422291 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:41.435722 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:41.436752 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2066007', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1629368'] for router_interface, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:41.578489 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Pushing event updated for resources: {'Port': ['ID=6db4124e-4bda-4bda-b604-9b9706732691,revision_number=2']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:41.719717 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-30bc4b15-15d3-43ec-9387-06dfa0a52ff0 req-64e9b720-2d37-423e-8c8e-3b0d97631ab5 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 210 time: 0.0484793 Dec 09 14:42:41.741552 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Network 9ab3f8b6-44d0-4210-907d-0e96072c4566 is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:42:41.743268 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:41.830474 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8459d9bf-ac4d-43d6-afed-01f0aff4a609 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for subnet, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:41.968029 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:42:41.997417 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e93fd4eb-71c5-461a-adc9-756d70f5106a req-7cf89f32-2b6d-4d01-a97a-a13a4f5c7084 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 210 time: 0.0698152 Dec 09 14:42:42.010489 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1626736', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1574391'] for router, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:42.030312 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8459d9bf-ac4d-43d6-afed-01f0aff4a609 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b3208488-2dcd-46dd-a486-7215caef7b14,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:42.050492 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1626736', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1574391'] for router, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:42.109063 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-daeebde8-c1fb-4172-a141-591f51c16e5b None None] Provisioning complete for port 6db4124e-4bda-4bda-b604-9b9706732691 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:42.109601 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-daeebde8-c1fb-4172-a141-591f51c16e5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:42.131907 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:42:42.132682 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8459d9bf-ac4d-43d6-afed-01f0aff4a609 admin admin] Checking segment: {'id': 'a84ec71a-f7fe-4f4f-adc5-96c2a8e50c39', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 446, 'network_id': '943f3673-367c-4473-94d4-fc84cf80be4c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:42.133054 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8459d9bf-ac4d-43d6-afed-01f0aff4a609 admin admin] Network hostable DHCP agents. Network: 943f3673-367c-4473-94d4-fc84cf80be4c, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109061) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:42:42.148196 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-832cc016-3b2f-476e-ac91-09bd7acafca6 admin admin] 10.222.0.39 "PUT /v2.0/routers/49df80d9-d5b4-4bb2-9772-8fb6fc15bcff/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6969008 Dec 09 14:42:42.170153 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-daeebde8-c1fb-4172-a141-591f51c16e5b None None] Port 6db4124e-4bda-4bda-b604-9b9706732691 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:42:42.216717 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8459d9bf-ac4d-43d6-afed-01f0aff4a609 admin admin] Network 943f3673-367c-4473-94d4-fc84cf80be4c is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109061) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:42:42.264236 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-8459d9bf-ac4d-43d6-afed-01f0aff4a609 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, 943f3673-367c-4473-94d4-fc84cf80be4c) {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:42.276783 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e890be6-4793-44e5-86ae-a7a2deaab917 None None] Network 943f3673-367c-4473-94d4-fc84cf80be4c requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:42:42.279916 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8459d9bf-ac4d-43d6-afed-01f0aff4a609 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:42.280834 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8459d9bf-ac4d-43d6-afed-01f0aff4a609 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:42.281017 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.44', 63426) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:42.330962 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-8459d9bf-ac4d-43d6-afed-01f0aff4a609 admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 2.5155635 Dec 09 14:42:42.463993 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Router 434b7b17-3c79-4e21-9abd-a8db38cd0969 is scheduled to L3 agent d9048829-2654-4d94-83cc-155a0884505e with binding_index 1 {{(pid=109061) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 14:42:42.470152 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Router 55e9791c-df4d-4622-ba5c-87f71cd3c12b is scheduled to L3 agent d9048829-2654-4d94-83cc-155a0884505e with binding_index 1 {{(pid=109061) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 14:42:42.544846 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c47d302d-beb6-47dc-8d9a-493f0e058d64 None None] Network 943f3673-367c-4473-94d4-fc84cf80be4c requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:42:42.607347 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ce9953-959c-498b-a239-cba26d7d473e req-71278514-47ed-4ad8-b709-d29f78bd68cf tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:42.630595 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-71278514-47ed-4ad8-b709-d29f78bd68cf tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "GET /v2.0/networks?id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d HTTP/1.1" status: 200 len: 815 time: 0.3482597 Dec 09 14:42:42.692091 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [req-d7ce9953-959c-498b-a239-cba26d7d473e req-7e71d95d-5c3d-4199-a4c5-964307ea7da2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Request body: {'port': {'device_id': 'c97d018e-9866-4c56-8334-267a2c2c4465', 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d', 'admin_state_up': True, 'tenant_id': '5ec989b7fd3e45f2b8962e012b0797ac'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:42.910221 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:42:42.919429 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:42:42.920808 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Sync routers for ids ['434b7b17-3c79-4e21-9abd-a8db38cd0969'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:42:42.947177 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Routers {'434b7b17-3c79-4e21-9abd-a8db38cd0969'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:42:42.947973 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:42:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['434b7b17-3c79-4e21-9abd-a8db38cd0969'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:42.990063 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.44', 63434) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:43.033720 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Sync routers for ids ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:42:43.060594 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Routers {'55e9791c-df4d-4622-ba5c-87f71cd3c12b'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:42:43.061270 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:42:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:43.089975 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:43.095928 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-beff5518-2d82-4d23-bc1a-bbdd2b31c519 admin admin] 10.222.0.39 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 7.3898144 Dec 09 14:42:43.097010 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51694) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:43.123175 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b816324f-8659-4f8c-b6b9-f782ab4f126f req-767c78ed-a4df-45bb-adbe-f8478024624c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 210 time: 0.1572134 Dec 09 14:42:43.256776 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d7ce9953-959c-498b-a239-cba26d7d473e req-7e71d95d-5c3d-4199-a4c5-964307ea7da2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Made reservation on behalf of 5ec989b7fd3e45f2b8962e012b0797ac for: {'port': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:43.264039 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-d7ce9953-959c-498b-a239-cba26d7d473e req-7e71d95d-5c3d-4199-a4c5-964307ea7da2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:43.337408 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Set router 434b7b17-3c79-4e21-9abd-a8db38cd0969 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:42:43.381359 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Set router 55e9791c-df4d-4622-ba5c-87f71cd3c12b gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:42:43.411727 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Sync routers for ids ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:42:43.414831 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 1a62fbb4-9280-496c-b60d-bf0b4423d01c up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:42:43.427360 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:43.447852 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-cea6bc0f-79a4-43d9-8ad2-d360e09fcc7d admin admin] 10.222.0.39 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 7.6899595 Dec 09 14:42:43.448473 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51712) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:43.509110 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Routers {'49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:42:43.509806 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:42:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:43.656763 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 1a62fbb4-9280-496c-b60d-bf0b4423d01c triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:43.658617 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:43.753014 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51716) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:43.753880 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51718) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:43.827552 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-e548968d-7996-44d8-9507-bded6188b5a3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1088591468', 'description': 'tempest-description--1191598368'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:43.827552 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-56d0395e-5df0-4644-aa17-c4afadf0763f req-df3c3dab-3a3a-4f4c-91ff-9e7a7587ea91 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 210 time: 0.2306900 Dec 09 14:42:43.870500 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [req-d7ce9953-959c-498b-a239-cba26d7d473e req-7e71d95d-5c3d-4199-a4c5-964307ea7da2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Allocated IP 172.20.0.7 (99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d/7c6b4bb0-bfec-44d0-8503-70917540b3c5/746ea6aa-be43-4fbf-9463-02d741db305a) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:42:43.877028 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Set router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:42:43.917807 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e548968d-7996-44d8-9507-bded6188b5a3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:44.033524 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 3, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:44.102470 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-91377dcd-f5b5-496b-8d2f-d1344f1fee70 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:44.111296 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-91377dcd-f5b5-496b-8d2f-d1344f1fee70 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.44 "GET /v2.0/networks?id=51590e0b-46a5-4e2e-8094-5ee83cac94b5 HTTP/1.1" status: 200 len: 811 time: 1.1153812 Dec 09 14:42:44.135255 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Checking router: 55e9791c-df4d-4622-ba5c-87f71cd3c12b for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:42:44.136125 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Updating router 55e9791c-df4d-4622-ba5c-87f71cd3c12b port 46ee0f4b-ef18-440f-a266-611402454855 binding host dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:42:44.171736 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'name': 'tempest-ServerRescueNegativeTestJSON-257021972-router', 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.159'}], 'enable_snat': True}, 'gw_port_id': '773a261e-796a-4ef7-b21d-e5fd6cad9fe8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:35Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 3, 'project_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'gw_port': {'id': '773a261e-796a-4ef7-b21d-e5fd6cad9fe8', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:87:29:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:38Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:44.223905 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-6abc5603-369b-44ba-b81a-c3a77efed2e4 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Request body: {'port': {'device_id': '201d80a0-533f-4dd7-bd29-b19f9a27b094', 'network_id': '51590e0b-46a5-4e2e-8094-5ee83cac94b5', 'admin_state_up': True, 'tenant_id': '1c1fb4e2e42c41e6bfff5cb72fe05656'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:44.287637 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Checking router: 434b7b17-3c79-4e21-9abd-a8db38cd0969 for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:42:44.287969 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Updating router 434b7b17-3c79-4e21-9abd-a8db38cd0969 port 773a261e-796a-4ef7-b21d-e5fd6cad9fe8 binding host dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:42:44.302382 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:44.389444 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e548968d-7996-44d8-9507-bded6188b5a3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:44.423283 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e548968d-7996-44d8-9507-bded6188b5a3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:44.426653 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:44.461851 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:44.565423 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51740) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:44.572589 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e548968d-7996-44d8-9507-bded6188b5a3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0305423b-9ab7-48eb-b33a-bd8e33378735,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:44.609915 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-d7ce9953-959c-498b-a239-cba26d7d473e req-7e71d95d-5c3d-4199-a4c5-964307ea7da2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:44.636565 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-723686975-network', 'tenant_id': '5e3aa7dd5137453fa81be091e253a686'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:44.667497 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e548968d-7996-44d8-9507-bded6188b5a3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:44.674052 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-e548968d-7996-44d8-9507-bded6188b5a3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.8735940 Dec 09 14:42:44.675026 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51744) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:44.679576 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e2077ebf-e9fa-4496-9479-f150c26dbc1a admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:44.708493 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-034a01c6-48bd-451e-a466-b042239a2550 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Request body: {'security_group_rule': {'security_group_id': '0305423b-9ab7-48eb-b33a-bd8e33378735', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:44.726545 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-81318f3b-4e4b-4b23-851e-05db37a32a51 req-5f9795ae-c8bd-44c0-bf69-0fddaba5023d tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 210 time: 0.0867472 Dec 09 14:42:44.800706 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.db.api [None req-034a01c6-48bd-451e-a466-b042239a2550 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Dec 09 14:42:44.800706 dv-cinder-819692-8-iscsi neutron-server[109062]: [SQL: DELETE FROM reservations WHERE reservations.project_id = %(project_id_1)s AND reservations.expiration < %(expiration_1)s] Dec 09 14:42:44.800706 dv-cinder-819692-8-iscsi neutron-server[109062]: [parameters: {'project_id_1': '6be5d78d2d0049448c3947b4e650758a', 'expiration_1': datetime.datetime(2021, 12, 9, 14, 42, 24, 729006)}] Dec 09 14:42:44.800706 dv-cinder-819692-8-iscsi neutron-server[109062]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=109062) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Dec 09 14:42:44.801595 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG oslo_db.api [None req-034a01c6-48bd-451e-a466-b042239a2550 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Dec 09 14:42:44.805438 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-6abc5603-369b-44ba-b81a-c3a77efed2e4 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Made reservation on behalf of 1c1fb4e2e42c41e6bfff5cb72fe05656 for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:44.809569 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-6abc5603-369b-44ba-b81a-c3a77efed2e4 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:44.816438 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] Made reservation on behalf of 5e3aa7dd5137453fa81be091e253a686 for: {'network': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:44.823116 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:44.851647 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:44.920693 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Publish callbacks [] for port, precommit_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:44.932230 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:44.938282 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-d7ce9953-959c-498b-a239-cba26d7d473e req-7e71d95d-5c3d-4199-a4c5-964307ea7da2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.079723 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Attempting to bind port 46ee0f4b-ef18-440f-a266-611402454855 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:42:45.082644 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Attempting to bind port 46ee0f4b-ef18-440f-a266-611402454855 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:42:45.083208 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Attempting to bind port 46ee0f4b-ef18-440f-a266-611402454855 on network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:42:45.098968 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] For port 1a62fbb4-9280-496c-b60d-bf0b4423d01c, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=1a62fbb4-9280-496c-b60d-bf0b4423d01c,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:42:45.104730 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.115991 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 42, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:42:45.119275 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Checking segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109064) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:45.119899 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.120468 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Bound using segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:42:45.122841 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Bound port: 46ee0f4b-ef18-440f-a266-611402454855, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:42:45.123477 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.130350 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f99fa9-65e9-40e5-aaa5-5e946a89bb1e None None] Pushing event updated for resources: {'Port': ['ID=46ee0f4b-ef18-440f-a266-611402454855,revision_number=2']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:45.187740 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1ea5ed9c-fc7f-4a06-9083-3ecab9091de6 req-acbbb038-14e3-42bf-aabe-c57fb6d59d32 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 210 time: 0.1529157 Dec 09 14:42:45.253749 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] For port 46ee0f4b-ef18-440f-a266-611402454855, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109064) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:42:45.258176 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] For port 46ee0f4b-ef18-440f-a266-611402454855, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=46ee0f4b-ef18-440f-a266-611402454855,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109064) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:42:45.265434 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.333917 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d7ce9953-959c-498b-a239-cba26d7d473e req-7e71d95d-5c3d-4199-a4c5-964307ea7da2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:42:45.354341 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e2077ebf-e9fa-4496-9479-f150c26dbc1a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.363478 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e71d95d-5c3d-4199-a4c5-964307ea7da2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Pushing event updated for resources: {'Port': ['ID=746ea6aa-be43-4fbf-9463-02d741db305a,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:45.366171 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [req-d7ce9953-959c-498b-a239-cba26d7d473e req-7e71d95d-5c3d-4199-a4c5-964307ea7da2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:45.400349 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [req-d7ce9953-959c-498b-a239-cba26d7d473e req-7e71d95d-5c3d-4199-a4c5-964307ea7da2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:42:45.406243 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Routers {'55e9791c-df4d-4622-ba5c-87f71cd3c12b'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:42:45.407046 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:42:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:45.419073 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ce9953-959c-498b-a239-cba26d7d473e req-7e71d95d-5c3d-4199-a4c5-964307ea7da2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:45.421738 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7f99fa9-65e9-40e5-aaa5-5e946a89bb1e None None] Pushing event updated for resources: {'Port': ['ID=46ee0f4b-ef18-440f-a266-611402454855,revision_number=3']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:45.429147 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-d7ce9953-959c-498b-a239-cba26d7d473e req-7e71d95d-5c3d-4199-a4c5-964307ea7da2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for port, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.432696 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e2077ebf-e9fa-4496-9479-f150c26dbc1a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.543126 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Publish callbacks [] for port, precommit_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.570413 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.571484 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device c5033ada-1e97-420a-a22d-70c7b1b64073 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:42:45.685182 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.704227 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] Set router 55e9791c-df4d-4622-ba5c-87f71cd3c12b gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:42:45.798032 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2077ebf-e9fa-4496-9479-f150c26dbc1a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5834b1fd-925b-4d55-959d-96dcf2e8ad89,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:45.805737 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-e2077ebf-e9fa-4496-9479-f150c26dbc1a admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=26b063c3350d488eb63556a024332a76&name=default HTTP/1.1" status: 200 len: 2996 time: 2.0143390 Dec 09 14:42:45.811422 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-7e71d95d-5c3d-4199-a4c5-964307ea7da2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.1250231 Dec 09 14:42:45.812030 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51762) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:45.815441 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.825816 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-034a01c6-48bd-451e-a466-b042239a2550 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.837393 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Attempting to bind port 773a261e-796a-4ef7-b21d-e5fd6cad9fe8 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:42:45.838083 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Attempting to bind port 773a261e-796a-4ef7-b21d-e5fd6cad9fe8 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:42:45.838604 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Attempting to bind port 773a261e-796a-4ef7-b21d-e5fd6cad9fe8 on network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:42:45.851361 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-6abc5603-369b-44ba-b81a-c3a77efed2e4 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Allocated IP 172.20.0.14 (51590e0b-46a5-4e2e-8094-5ee83cac94b5/ae0e8ccb-a0a9-4f5b-93f6-77fb4806d03e/64e629a5-6b0c-4cc9-87b6-9a69a3792836) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:42:45.871135 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 42, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:42:45.872060 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Checking segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:45.872630 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.873175 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Bound using segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:42:45.873819 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Bound port: 773a261e-796a-4ef7-b21d-e5fd6cad9fe8, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:42:45.874362 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.936653 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] For port 773a261e-796a-4ef7-b21d-e5fd6cad9fe8, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:42:45.941099 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] For port 773a261e-796a-4ef7-b21d-e5fd6cad9fe8, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=773a261e-796a-4ef7-b21d-e5fd6cad9fe8,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:42:45.959578 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:45.985497 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port c5033ada-1e97-420a-a22d-70c7b1b64073 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:45.986329 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.129073 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Pushing event updated for resources: {'Port': ['ID=1a62fbb4-9280-496c-b60d-bf0b4423d01c,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:46.161911 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.178855 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-2439a34c-3a87-48ad-8232-dca43d6ca924 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] http://10.222.0.39:9696/v2.0/extensions returned with HTTP 200 {{(pid=109062) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 14:42:46.180477 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-2439a34c-3a87-48ad-8232-dca43d6ca924 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0251193 Dec 09 14:42:46.238684 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 418} {{(pid=109062) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:42:46.279006 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5c83acf-7f79-4ec0-90f1-302acaf416d2 None None] Pushing event updated for resources: {'Port': ['ID=773a261e-796a-4ef7-b21d-e5fd6cad9fe8,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:46.310204 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a16f5694-63bc-43f8-b6bc-b52b46d7a0ac admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.318491 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.319326 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.segments_db [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] Added segment 6104336b-19b9-49e8-a793-5896c7f78f80 of type vlan for network 639d6dc8-f9d3-4a62-989c-6340f8dfd6a0 Dec 09 14:42:46.326011 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Routers {'434b7b17-3c79-4e21-9abd-a8db38cd0969'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:42:46.328867 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:42:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['434b7b17-3c79-4e21-9abd-a8db38cd0969'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:46.339134 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8548e4a9-3dfa-49e8-b1d8-7b0c17087ef8,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:46.367391 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-034a01c6-48bd-451e-a466-b042239a2550 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.412003 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-034a01c6-48bd-451e-a466-b042239a2550 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.421994 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 3, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:46.441198 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a16f5694-63bc-43f8-b6bc-b52b46d7a0ac admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.468280 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-034a01c6-48bd-451e-a466-b042239a2550 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.469649 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-034a01c6-48bd-451e-a466-b042239a2550 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.7690876 Dec 09 14:42:46.473515 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.481221 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51766) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:46.502108 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfce6ef4-98dc-40d0-8750-302367c0be25 None None] The sync data for ids ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'] in dv-cinder-819692-8-iscsi is: [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 3, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:42:46.531253 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-fc170a29-864b-480d-beb4-48f67d258e39 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Request body: {'security_group_rule': {'security_group_id': '0305423b-9ab7-48eb-b33a-bd8e33378735', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:46.556116 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2a22e64-2607-4a16-b895-b88ecd4f3a42 req-7da2475b-aed3-4c36-b035-54f285b09105 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:46.557377 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c039a5b9-26d0-4784-9d8c-b12b35ea0037 req-0491d96a-d095-4204-a86b-0d74ae005396 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 210 time: 0.1268411 Dec 09 14:42:46.565727 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a2a22e64-2607-4a16-b895-b88ecd4f3a42 req-7da2475b-aed3-4c36-b035-54f285b09105 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 931 time: 0.6001370 Dec 09 14:42:46.565914 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-034a01c6-48bd-451e-a466-b042239a2550 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c037e603-b766-49f4-8b24-972631a200eb,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:46.593259 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-fc170a29-864b-480d-beb4-48f67d258e39 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.623062 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] Set router 434b7b17-3c79-4e21-9abd-a8db38cd0969 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:42:46.668827 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.670047 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:46.670704 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.747991 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] Pushing event updated for resources: {'Network': ['ID=639d6dc8-f9d3-4a62-989c-6340f8dfd6a0,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:46.779990 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-8d765b75-b9b9-4520-a5e5-d90ef8ff52c5 admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 2.1958640 Dec 09 14:42:46.780615 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51768) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:46.783369 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-fc170a29-864b-480d-beb4-48f67d258e39 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.792637 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-f42f8a7c-253f-400f-9d60-8913e1af71bd admin admin] Request body: {'subnet': {'network_id': '639d6dc8-f9d3-4a62-989c-6340f8dfd6a0', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-723686975-subnet', 'tenant_id': '5e3aa7dd5137453fa81be091e253a686', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:46.797357 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-fc170a29-864b-480d-beb4-48f67d258e39 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.805868 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a2a22e64-2607-4a16-b895-b88ecd4f3a42 req-73f22906-daf5-4630-b47f-3f7f7a04579a tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2377057 Dec 09 14:42:46.826643 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a16f5694-63bc-43f8-b6bc-b52b46d7a0ac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.829587 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a16f5694-63bc-43f8-b6bc-b52b46d7a0ac admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.833953 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-a16f5694-63bc-43f8-b6bc-b52b46d7a0ac admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/5834b1fd-925b-4d55-959d-96dcf2e8ad89 HTTP/1.1" status: 204 len: 168 time: 1.0091667 Dec 09 14:42:46.837718 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc170a29-864b-480d-beb4-48f67d258e39 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0e7a78d0-24e5-4bfb-bfbe-ecc1ba8e038a,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:46.850783 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-fc170a29-864b-480d-beb4-48f67d258e39 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:46.855199 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-fc170a29-864b-480d-beb4-48f67d258e39 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3271105 Dec 09 14:42:46.855199 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a16f5694-63bc-43f8-b6bc-b52b46d7a0ac admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5834b1fd-925b-4d55-959d-96dcf2e8ad89,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:46.859981 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51774) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:46.866443 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Request body: {'floatingip': {'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:46.926852 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f42f8a7c-253f-400f-9d60-8913e1af71bd admin admin] Made reservation on behalf of 5e3aa7dd5137453fa81be091e253a686 for: {'subnet': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:42:46.934861 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f42f8a7c-253f-400f-9d60-8913e1af71bd admin admin] Publish callbacks [] for subnet, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:47.070411 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network 639d6dc8-f9d3-4a62-989c-6340f8dfd6a0 details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:42:47.079819 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:39Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '6db4124e-4bda-4bda-b604-9b9706732691', 'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'mac_address': 'fa:16:3e:7f:fb:db', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:41Z', 'revision_number': 2, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'subnets': [{'id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:47.145217 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-6abc5603-369b-44ba-b81a-c3a77efed2e4 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:47.195484 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:47.201053 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Checking router: 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:42:47.201761 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Updating router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff port 6db4124e-4bda-4bda-b604-9b9706732691 binding host dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:42:47.255399 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:47.356570 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-6abc5603-369b-44ba-b81a-c3a77efed2e4 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:47.390551 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for floatingip, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:47.573022 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:47.650060 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'name': 'tempest-ServerRescueNegativeTestJSON-257021972-router', 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.159'}], 'enable_snat': True}, 'gw_port_id': '773a261e-796a-4ef7-b21d-e5fd6cad9fe8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:35Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 3, 'project_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'gw_port': {'id': '773a261e-796a-4ef7-b21d-e5fd6cad9fe8', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:87:29:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:47.775494 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Request body: {'port': {'device_id': 'c97d018e-9866-4c56-8334-267a2c2c4465', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:47.785747 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fe5920ee-7416-4a37-b3a3-b88f8dd3c5b9 None None] The sync data for ids ['434b7b17-3c79-4e21-9abd-a8db38cd0969'] in dv-cinder-819692-8-iscsi is: [{'id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'name': 'tempest-ServerRescueNegativeTestJSON-257021972-router', 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.159'}], 'enable_snat': True}, 'gw_port_id': '773a261e-796a-4ef7-b21d-e5fd6cad9fe8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:35Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 3, 'project_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'gw_port': {'id': '773a261e-796a-4ef7-b21d-e5fd6cad9fe8', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:87:29:52', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:42:47.791545 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f42f8a7c-253f-400f-9d60-8913e1af71bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for subnet, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:47.800601 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5c83acf-7f79-4ec0-90f1-302acaf416d2 None None] Pushing event updated for resources: {'Port': ['ID=773a261e-796a-4ef7-b21d-e5fd6cad9fe8,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:48.054131 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6abc5603-369b-44ba-b81a-c3a77efed2e4 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Pushing event updated for resources: {'Port': ['ID=64e629a5-6b0c-4cc9-87b6-9a69a3792836,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:48.147643 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f42f8a7c-253f-400f-9d60-8913e1af71bd admin admin] Pushing event updated for resources: {'Subnet': ['ID=87fdde01-4faa-47ee-90e2-4d3ae4c4d761,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:48.477076 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:48.486242 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-6abc5603-369b-44ba-b81a-c3a77efed2e4 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Network 51590e0b-46a5-4e2e-8094-5ee83cac94b5 is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:42:48.505020 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-6abc5603-369b-44ba-b81a-c3a77efed2e4 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:48.548036 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-6abc5603-369b-44ba-b81a-c3a77efed2e4 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:42:48.559729 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-6abc5603-369b-44ba-b81a-c3a77efed2e4 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:48.561047 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-6abc5603-369b-44ba-b81a-c3a77efed2e4 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:48.649215 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Publish callbacks [] for port, precommit_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:48.657699 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 46ee0f4b-ef18-440f-a266-611402454855 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:42:48.696368 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:48.958656 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26d68bc6-9e38-4333-842e-150e131a7f61 req-4d32d538-24d8-43f9-9fc6-f73b2726cde7 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:48.959091 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41186b7d-b61d-437d-a6c0-6bfe680db2a1 None None] Pushing event updated for resources: {'Port': ['ID=6db4124e-4bda-4bda-b604-9b9706732691,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:48.963450 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-26d68bc6-9e38-4333-842e-150e131a7f61 req-4d32d538-24d8-43f9-9fc6-f73b2726cde7 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 931 time: 0.8492978 Dec 09 14:42:49.129971 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Allocated IP 172.20.0.1 (1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b/4b7e026c-4454-4200-91c3-30d27a976452/ade23a8f-bc90-4df9-9f92-95d4b4587037) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:42:49.141043 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 46ee0f4b-ef18-440f-a266-611402454855 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:49.141405 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:49.200164 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Attempting to bind port 6db4124e-4bda-4bda-b604-9b9706732691 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:42:49.200535 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Attempting to bind port 6db4124e-4bda-4bda-b604-9b9706732691 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:42:49.200898 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Attempting to bind port 6db4124e-4bda-4bda-b604-9b9706732691 on network 9ab3f8b6-44d0-4210-907d-0e96072c4566 {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:42:49.209880 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11da7247-8d98-4f85-b117-ecf24ab65d02 req-d1ff4fd1-383d-4ffa-a907-93bd6bdaeb19 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:49.218446 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-11da7247-8d98-4f85-b117-ecf24ab65d02 req-d1ff4fd1-383d-4ffa-a907-93bd6bdaeb19 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 932 time: 1.4355516 Dec 09 14:42:49.230146 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 42, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:42:49.230528 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Checking segment: {'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:49.230912 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:49.231313 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Bound using segment: {'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:42:49.244860 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Bound port: 6db4124e-4bda-4bda-b604-9b9706732691, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:42:49.245458 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:49.249389 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f42f8a7c-253f-400f-9d60-8913e1af71bd admin admin] Checking segment: {'id': '6104336b-19b9-49e8-a793-5896c7f78f80', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 418, 'network_id': '639d6dc8-f9d3-4a62-989c-6340f8dfd6a0'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109062) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:49.250045 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f42f8a7c-253f-400f-9d60-8913e1af71bd admin admin] Network hostable DHCP agents. Network: 639d6dc8-f9d3-4a62-989c-6340f8dfd6a0, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109062) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:42:49.325936 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:49.378013 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-11da7247-8d98-4f85-b117-ecf24ab65d02 req-cda46aaf-ddc6-41fe-93fe-6592d6777af9 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1555130 Dec 09 14:42:49.407068 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:49.432479 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] For port 6db4124e-4bda-4bda-b604-9b9706732691, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:42:49.436627 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:42:49.444217 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f42f8a7c-253f-400f-9d60-8913e1af71bd admin admin] Network 639d6dc8-f9d3-4a62-989c-6340f8dfd6a0 is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109062) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:42:49.499498 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-6abc5603-369b-44ba-b81a-c3a77efed2e4 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 5.2940505 Dec 09 14:42:49.520713 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:49.538385 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:49.652650 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] For port 6db4124e-4bda-4bda-b604-9b9706732691, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=6db4124e-4bda-4bda-b604-9b9706732691,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:42:49.654588 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] For port 46ee0f4b-ef18-440f-a266-611402454855, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=46ee0f4b-ef18-440f-a266-611402454855,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:42:49.664403 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:49.685333 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-951dc234-007b-4fec-9b8c-aefbd2e4a3e9 None None] Provisioning complete for port 6db4124e-4bda-4bda-b604-9b9706732691 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:49.685615 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-951dc234-007b-4fec-9b8c-aefbd2e4a3e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:49.716713 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Allocated IP 172.27.0.157 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/bd7b5fa1-313f-4c93-b03c-98217d4feefd) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:42:49.793551 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:49.798781 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 1a62fbb4-9280-496c-b60d-bf0b4423d01c up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:42:49.829838 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Allocated IP 172.20.0.1 (8ff38a1e-5122-4806-8b7d-d4c281cbe550/90388423-2d07-4cbe-80d8-fa2f6a3c14f7/35277c8d-e624-48fc-97ae-fcec8459f3ca) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:42:49.973985 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:49.982346 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-f42f8a7c-253f-400f-9d60-8913e1af71bd admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, 639d6dc8-f9d3-4a62-989c-6340f8dfd6a0) {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:49.994935 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f42f8a7c-253f-400f-9d60-8913e1af71bd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:49.997884 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f42f8a7c-253f-400f-9d60-8913e1af71bd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.045167 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-67b463b3-f66d-4d02-8e7d-a239fcbb7826 None None] Network 639d6dc8-f9d3-4a62-989c-6340f8dfd6a0 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:42:50.053361 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Routers {'49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:42:50.054439 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:42:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:50.072722 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:42:50.105582 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-f42f8a7c-253f-400f-9d60-8913e1af71bd admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 3.3187563 Dec 09 14:42:50.117195 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:50.117383 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41186b7d-b61d-437d-a6c0-6bfe680db2a1 None None] Pushing event updated for resources: {'Port': ['ID=6db4124e-4bda-4bda-b604-9b9706732691,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:50.179796 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-26d68bc6-9e38-4333-842e-150e131a7f61 req-23fad961-621a-485f-9f64-6aed79333632 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.1937668 Dec 09 14:42:50.180805 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:42:50.190939 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1574184'] for router_interface, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.233537 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.269256 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:42:50.277773 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:50.285040 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:42:50.313725 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Pushing event updated for resources: {'Port': ['ID=ade23a8f-bc90-4df9-9f92-95d4b4587037,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:50.366937 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51830) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:50.378626 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] Set router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:42:50.425129 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_v2 [None req-f54a9f45-58fe-4875-8c55-cdd2e263ca15 admin admin] Deleting subnet b3208488-2dcd-46dd-a486-7215caef7b14 {{(pid=109061) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:42:50.441648 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.449229 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f54a9f45-58fe-4875-8c55-cdd2e263ca15 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.469318 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Pushing event updated for resources: {'Port': ['ID=46ee0f4b-ef18-440f-a266-611402454855,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:50.514882 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event updated for resources: {'Port': ['ID=bd7b5fa1-313f-4c93-b03c-98217d4feefd,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:50.524973 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 1a62fbb4-9280-496c-b60d-bf0b4423d01c triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:50.525352 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.567332 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.notifiers.nova [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 746ea6aa-be43-4fbf-9463-02d741db305a {{(pid=109062) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:42:50.574593 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f54a9f45-58fe-4875-8c55-cdd2e263ca15 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.590761 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.595331 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.597134 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f54a9f45-58fe-4875-8c55-cdd2e263ca15 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.669170 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.670185 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.673024 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.provisioning_blocks [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Transition to ACTIVE for port object 746ea6aa-be43-4fbf-9463-02d741db305a will not be triggered until provisioned by entity L2. {{(pid=109062) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:42:50.681837 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe663ba-3512-44fc-8480-4b9fa45543d0 req-a47c5f8b-df64-4af0-ad99-c63eb7a25d4b tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:50.683427 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0fe663ba-3512-44fc-8480-4b9fa45543d0 req-a47c5f8b-df64-4af0-ad99-c63eb7a25d4b tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 932 time: 0.2029858 Dec 09 14:42:50.702431 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.721907 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.734315 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:42:50.734534 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b455c1e-57ec-412c-a2d2-25483f038e87 None None] Network 639d6dc8-f9d3-4a62-989c-6340f8dfd6a0 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:42:50.740400 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-951dc234-007b-4fec-9b8c-aefbd2e4a3e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.751663 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:50.756860 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:42:50.757358 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1574184'] for router_interface, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.802051 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Pushing event updated for resources: {'Port': ['ID=35277c8d-e624-48fc-97ae-fcec8459f3ca,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:50.826289 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0fe663ba-3512-44fc-8480-4b9fa45543d0 req-404236ed-7eae-4ace-b6d7-e5d88458764f tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1253901 Dec 09 14:42:50.830754 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Pushing event updated for resources: {'Port': ['ID=746ea6aa-be43-4fbf-9463-02d741db305a,revision_number=2']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:50.845351 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f54a9f45-58fe-4875-8c55-cdd2e263ca15 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for subnet, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.875638 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-951dc234-007b-4fec-9b8c-aefbd2e4a3e9 None None] For port 6db4124e-4bda-4bda-b604-9b9706732691, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=6db4124e-4bda-4bda-b604-9b9706732691,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:42:50.894469 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-951dc234-007b-4fec-9b8c-aefbd2e4a3e9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.936704 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f54a9f45-58fe-4875-8c55-cdd2e263ca15 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:50.948069 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-f54a9f45-58fe-4875-8c55-cdd2e263ca15 admin admin] 10.222.0.39 "DELETE /v2.0/subnets/b3208488-2dcd-46dd-a486-7215caef7b14 HTTP/1.1" status: 204 len: 168 time: 0.5771613 Dec 09 14:42:50.948069 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f54a9f45-58fe-4875-8c55-cdd2e263ca15 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b3208488-2dcd-46dd-a486-7215caef7b14,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:50.964141 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 51840) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:51.019955 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-951dc234-007b-4fec-9b8c-aefbd2e4a3e9 None None] Pushing event updated for resources: {'Port': ['ID=6db4124e-4bda-4bda-b604-9b9706732691,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:51.031196 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '6db4124e-4bda-4bda-b604-9b9706732691', 'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'mac_address': 'fa:16:3e:7f:fb:db', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'subnets': [{'id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:51.081889 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-671b8fcd-bf50-40df-ae06-dc4fcff141b9 None None] The sync data for ids ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'] in dv-cinder-819692-8-iscsi is: [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '6db4124e-4bda-4bda-b604-9b9706732691', 'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'mac_address': 'fa:16:3e:7f:fb:db', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'subnets': [{'id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:42:51.091197 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-fa4c1cf1-4b86-4bc5-a0b2-bf7c1ab72b7b None None] Provisioning complete for port ade23a8f-bc90-4df9-9f92-95d4b4587037 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:51.091572 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-fa4c1cf1-4b86-4bc5-a0b2-bf7c1ab72b7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.145274 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-fa4c1cf1-4b86-4bc5-a0b2-bf7c1ab72b7b None None] Port ade23a8f-bc90-4df9-9f92-95d4b4587037 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:42:51.171915 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-fa4c1cf1-4b86-4bc5-a0b2-bf7c1ab72b7b None None] Provisioning complete for port 6db4124e-4bda-4bda-b604-9b9706732691 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:51.172898 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-fa4c1cf1-4b86-4bc5-a0b2-bf7c1ab72b7b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.187147 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.managers [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Attempting to bind port 746ea6aa-be43-4fbf-9463-02d741db305a on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109062) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:42:51.187338 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.managers [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Attempting to bind port 746ea6aa-be43-4fbf-9463-02d741db305a by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'}] {{(pid=109062) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:42:51.187782 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Attempting to bind port 746ea6aa-be43-4fbf-9463-02d741db305a on network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d {{(pid=109062) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:42:51.222627 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Port 746ea6aa-be43-4fbf-9463-02d741db305a on network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109062) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:42:51.223126 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Attempting to bind port 746ea6aa-be43-4fbf-9463-02d741db305a on network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d {{(pid=109062) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:42:51.254803 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 42, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109062) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:42:51.255702 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Checking segment: {'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109062) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:51.256433 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Bound using segment: {'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'} {{(pid=109062) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:42:51.257003 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.managers [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Bound port: 746ea6aa-be43-4fbf-9463-02d741db305a, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'}}] {{(pid=109062) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:42:51.257445 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.273755 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 46ee0f4b-ef18-440f-a266-611402454855 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:42:51.321179 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.333496 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.430956 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.438367 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 46ee0f4b-ef18-440f-a266-611402454855 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:51.438552 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.457185 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event updated for resources: {'Port': ['ID=bd7b5fa1-313f-4c93-b03c-98217d4feefd,revision_number=2']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:51.474674 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.476442 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-34bf6dc6-d409-4db7-8463-596428cd6795 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 4.6152194 Dec 09 14:42:51.623518 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.db [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] For port 746ea6aa-be43-4fbf-9463-02d741db305a, host hv-cinder-81969, cleared binding levels {{(pid=109062) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:42:51.644894 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.db [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] For port 746ea6aa-be43-4fbf-9463-02d741db305a, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=746ea6aa-be43-4fbf-9463-02d741db305a,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109062) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:42:51.654105 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.683519 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 773a261e-796a-4ef7-b21d-e5fd6cad9fe8 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:42:51.718161 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.748803 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.776629 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:51.777652 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for port, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.780056 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] 10.222.0.44 "PUT /v2.0/ports/746ea6aa-be43-4fbf-9463-02d741db305a HTTP/1.1" status: 200 len: 1093 time: 4.4852414 Dec 09 14:42:51.780792 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-003a1bbf-016a-41fe-84b9-33cd73a5ff8e req-466ff0f4-0c4f-4c6d-9c95-b2de738381c9 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:51.781094 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c97d018e-9866-4c56-8334-267a2c2c4465', 'tag': '746ea6aa-be43-4fbf-9463-02d741db305a'}] {{(pid=109062) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:42:51.782851 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-003a1bbf-016a-41fe-84b9-33cd73a5ff8e req-466ff0f4-0c4f-4c6d-9c95-b2de738381c9 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 943 time: 0.3747160 Dec 09 14:42:51.819131 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 773a261e-796a-4ef7-b21d-e5fd6cad9fe8 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:51.819857 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.910641 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.927796 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.963662 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] For port 773a261e-796a-4ef7-b21d-e5fd6cad9fe8, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=773a261e-796a-4ef7-b21d-e5fd6cad9fe8,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:42:51.970185 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.971014 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2066007', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1629368'] for router_interface, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:51.973320 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:52.016104 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5876bdc-24d1-4e6d-be14-0b74edf64bc4 service neutron] Pushing event updated for resources: {'Port': ['ID=746ea6aa-be43-4fbf-9463-02d741db305a,revision_number=3']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:52.123483 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-97bb4131-9b4e-434c-b21d-425beed0816f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?name=tempest-securitygroup--1088591468&fields=id&tenant_id=6be5d78d2d0049448c3947b4e650758a HTTP/1.1" status: 200 len: 267 time: 0.2392871 Dec 09 14:42:52.146287 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Pushing event updated for resources: {'Port': ['ID=773a261e-796a-4ef7-b21d-e5fd6cad9fe8,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:52.191100 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:52.301877 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-10b0fa23-abca-4362-9d8c-a1c72bc1a0ce tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:52.304284 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-10b0fa23-abca-4362-9d8c-a1c72bc1a0ce tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/networks?id=9ab3f8b6-44d0-4210-907d-0e96072c4566 HTTP/1.1" status: 200 len: 816 time: 0.1716909 Dec 09 14:42:52.306871 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3f1ec408b0eec5a36b56e0a757eff0f4875d9a95eff62f4d0b4a62bb27a3b600" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-125f376b-b091-44d0-9491-29d831e4f6ee" -d '{"events": [{"name": "network-changed", "server_uuid": "c97d018e-9866-4c56-8334-267a2c2c4465", "tag": "746ea6aa-be43-4fbf-9463-02d741db305a"}]}' {{(pid=109062) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:42:52.323938 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-b3cd1261-a344-4955-8592-fd947370bbe3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/quotas/6be5d78d2d0049448c3947b4e650758a HTTP/1.1" status: 200 len: 375 time: 0.0128469 Dec 09 14:42:52.370147 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-003a1bbf-016a-41fe-84b9-33cd73a5ff8e req-63cc1592-8532-498e-a6d8-2765cf4b007f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5732207 Dec 09 14:42:52.372541 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=109061) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:52.372899 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=109061) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:52.373695 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=109061) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:52.374015 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Subscribe: > port after_create 55550000 {{(pid=109061) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:52.374352 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Subscribe: > port after_delete 55550000 {{(pid=109061) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:52.374695 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Subscribe: > port after_update 55550000 {{(pid=109061) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:52.375790 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=109061) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:52.375790 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=109061) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:52.375790 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=109061) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:52.376115 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=109061) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:52.442508 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8885a77f-545d-40fa-9b5f-446c8d3ba6cc tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=6be5d78d2d0049448c3947b4e650758a&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1100280 Dec 09 14:42:52.622611 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-73966b64-ba06-46a2-9a74-8cfa3b0713f9 service neutron] 10.222.0.39 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1443338 Dec 09 14:42:52.763599 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-c7fb5f23-2a24-4b3d-af93-f696f18330ae service neutron] 10.222.0.39 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1297626 Dec 09 14:42:52.795175 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=109061) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:52.795832 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=109061) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:52.797850 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=109061) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:52.798302 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=109061) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:52.798844 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['943f3673-367c-4473-94d4-fc84cf80be4c']}} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:52.844855 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a84ec71a-f7fe-4f4f-adc5-96c2a8e50c39') {'for_net_delete': True} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:52.845204 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a84ec71a-f7fe-4f4f-adc5-96c2a8e50c39') {} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:52.864168 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1271949'] for segment, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:52.897095 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:52.908246 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Releasing vlan 446 on physical network physnet1 to pool {{(pid=109061) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:42:52.909084 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-133412129'] for segment, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: from cryptography.utils import int_from_bytes Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: from cryptography.utils import int_from_bytes Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: Traceback (most recent call last): Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: timer() Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: cb(*args, **kw) Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: return func(*args, **kwargs) Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: self._notify() Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: self.callback(batched_events) Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: event.method(event) Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: return f(self, *a, **k) Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._get(url).json() Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: return self.request(url, 'GET', **kwargs) Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:42:52.923858 dv-cinder-819692-8-iscsi neutron-server[109061]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:42:52.976832 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Pushing event updated for resources: {'Port': ['ID=ade23a8f-bc90-4df9-9f92-95d4b4587037,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:53.156278 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-085e85b4-ee8e-4106-9076-9779dda29a1d req-38f15b59-b8ed-4020-84a6-6689cf2d7670 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:53.158282 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-085e85b4-ee8e-4106-9076-9779dda29a1d req-38f15b59-b8ed-4020-84a6-6689cf2d7670 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 932 time: 0.2310379 Dec 09 14:42:53.168756 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:53.176412 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:53.184413 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51896) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:53.191501 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] 10.222.0.39 "DELETE /v2.0/networks/943f3673-367c-4473-94d4-fc84cf80be4c HTTP/1.1" status: 204 len: 168 time: 2.1880581 Dec 09 14:42:53.214305 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 6db4124e-4bda-4bda-b604-9b9706732691 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:42:53.307049 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-085e85b4-ee8e-4106-9076-9779dda29a1d req-4a681a77-1985-4408-93d0-e9c712478cdf tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0817473 Dec 09 14:42:53.362483 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_v2 [None req-087b8c96-cff7-4fce-b127-648c444e3be7 admin admin] Deleting subnet 87fdde01-4faa-47ee-90e2-4d3ae4c4d761 {{(pid=109062) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:42:53.366375 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-087b8c96-cff7-4fce-b127-648c444e3be7 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:53.378825 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 6db4124e-4bda-4bda-b604-9b9706732691 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:53.379455 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:53.387241 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:42:53.388455 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-988abbf6-9f60-4020-aca9-5fbe583f2086 admin admin] Pushing event deleted for resources: {'Network': ['ID=943f3673-367c-4473-94d4-fc84cf80be4c,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:53.411928 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-087b8c96-cff7-4fce-b127-648c444e3be7 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:53.426654 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-087b8c96-cff7-4fce-b127-648c444e3be7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:53.449957 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:53.570242 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2b173130-a18a-43d9-a233-bd276e46a4d0 req-75d1469c-9100-48e5-bfec-59f2a3df6113 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 210 time: 0.1514070 Dec 09 14:42:53.612067 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-087b8c96-cff7-4fce-b127-648c444e3be7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for subnet, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:53.662053 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:53.662709 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 773a261e-796a-4ef7-b21d-e5fd6cad9fe8 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:42:53.759683 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:42:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de356830-8afd-4f5a-ad2f-e4d525f0e201 x-openstack-request-id: req-de356830-8afd-4f5a-ad2f-e4d525f0e201 {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:42:53.760142 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c97d018e-9866-4c56-8334-267a2c2c4465", "tag": "746ea6aa-be43-4fbf-9463-02d741db305a", "status": "completed", "code": 200}]} {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:42:53.760325 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-de356830-8afd-4f5a-ad2f-e4d525f0e201 {{(pid=109062) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:42:53.760862 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c97d018e-9866-4c56-8334-267a2c2c4465', 'tag': '746ea6aa-be43-4fbf-9463-02d741db305a', 'status': 'completed', 'code': 200} Dec 09 14:42:53.770996 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-087b8c96-cff7-4fce-b127-648c444e3be7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:53.781512 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-087b8c96-cff7-4fce-b127-648c444e3be7 admin admin] 10.222.0.39 "DELETE /v2.0/subnets/87fdde01-4faa-47ee-90e2-4d3ae4c4d761 HTTP/1.1" status: 204 len: 168 time: 0.5926833 Dec 09 14:42:53.782238 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51910) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:53.801112 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-087b8c96-cff7-4fce-b127-648c444e3be7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=87fdde01-4faa-47ee-90e2-4d3ae4c4d761,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:53.848658 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 773a261e-796a-4ef7-b21d-e5fd6cad9fe8 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:53.851244 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:53.863472 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:53.895492 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Request body: {'port': {'device_id': '201d80a0-533f-4dd7-bd29-b19f9a27b094', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:53.987072 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:54.016756 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-125f376b-b091-44d0-9491-29d831e4f6ee req-80940df3-560b-4c6f-a132-185452238c78 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:54.027667 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-125f376b-b091-44d0-9491-29d831e4f6ee req-80940df3-560b-4c6f-a132-185452238c78 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=5ec989b7fd3e45f2b8962e012b0797ac&device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 1096 time: 0.1513677 Dec 09 14:42:54.068393 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5cea3c73-1692-4ad4-8365-1c82e409c130 None None] Provisioning complete for port ade23a8f-bc90-4df9-9f92-95d4b4587037 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:54.069130 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5cea3c73-1692-4ad4-8365-1c82e409c130 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:54.078672 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Pushing event updated for resources: {'Port': ['ID=35277c8d-e624-48fc-97ae-fcec8459f3ca,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:54.208630 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fabcb8ee-7485-4187-a82b-13ee2e55e835 req-a45c3101-a830-4e9a-b7e8-b7b9645b8cb3 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:54.210500 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fabcb8ee-7485-4187-a82b-13ee2e55e835 req-a45c3101-a830-4e9a-b7e8-b7b9645b8cb3 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 943 time: 0.4175684 Dec 09 14:42:54.212025 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:54.268612 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Subscribe: > segment before_delete 55550000 {{(pid=109062) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:54.268965 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=109062) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:54.269720 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=109062) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:54.270059 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Subscribe: > port after_create 55550000 {{(pid=109062) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:54.270387 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Subscribe: > port after_delete 55550000 {{(pid=109062) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:54.270735 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Subscribe: > port after_update 55550000 {{(pid=109062) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:54.271054 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Subscribe: > segment after_delete 55550000 {{(pid=109062) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:54.271376 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Subscribe: > subnet after_create 55550000 {{(pid=109062) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:54.271773 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=109062) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:54.272119 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Subscribe: > subnet after_update 55550000 {{(pid=109062) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:54.361460 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:54.401415 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5cea3c73-1692-4ad4-8365-1c82e409c130 None None] Port ade23a8f-bc90-4df9-9f92-95d4b4587037 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:42:54.428216 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2066007', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1629368'] for router_interface, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:54.450984 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Subscribe: > subnet after_create 55550000 {{(pid=109062) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:54.459465 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=109062) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:54.460070 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Subscribe: > subnet before_create 55550000 {{(pid=109062) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:54.460553 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Subscribe: > subnet before_update 55550000 {{(pid=109062) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Dec 09 14:42:54.461065 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['639d6dc8-f9d3-4a62-989c-6340f8dfd6a0']}} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:54.602977 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6104336b-19b9-49e8-a793-5896c7f78f80') {'for_net_delete': True} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:54.603178 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6104336b-19b9-49e8-a793-5896c7f78f80') {} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:54.659437 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ae2943c-cfc9-413a-9e10-83cb4c442cfe req-45700b8d-5dec-4c42-8110-0ffd4113eeca tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:54.663818 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8ae2943c-cfc9-413a-9e10-83cb4c442cfe req-45700b8d-5dec-4c42-8110-0ffd4113eeca tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 932 time: 0.1946681 Dec 09 14:42:54.668125 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-130415758'] for segment, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:54.672331 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fabcb8ee-7485-4187-a82b-13ee2e55e835 req-d5c4f8e6-c269-4d74-898f-77dbde402b63 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3552709 Dec 09 14:42:54.731209 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Router 55e9791c-df4d-4622-ba5c-87f71cd3c12b has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:42:54.735176 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:54.755263 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Releasing vlan 418 on physical network physnet1 to pool {{(pid=109062) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:42:54.755675 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-130461398'] for segment, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: from cryptography.utils import int_from_bytes Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: from cryptography.utils import int_from_bytes Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: Traceback (most recent call last): Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: timer() Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: cb(*args, **kw) Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: return func(*args, **kwargs) Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: self._notify() Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: self.callback(batched_events) Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: event.method(event) Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: return f(self, *a, **k) Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._get(url).json() Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: return self.request(url, 'GET', **kwargs) Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:42:54.759942 dv-cinder-819692-8-iscsi neutron-server[109062]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:42:54.855684 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8ae2943c-cfc9-413a-9e10-83cb4c442cfe req-994cd05b-a502-4b32-8801-537ff162d2fc tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1823575 Dec 09 14:42:54.879117 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:54.914451 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:54.919194 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] 10.222.0.39 "DELETE /v2.0/networks/639d6dc8-f9d3-4a62-989c-6340f8dfd6a0 HTTP/1.1" status: 204 len: 168 time: 1.1358883 Dec 09 14:42:54.921265 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-629382f3-498c-4286-af5c-53a4d2d2549e admin admin] Pushing event deleted for resources: {'Network': ['ID=639d6dc8-f9d3-4a62-989c-6340f8dfd6a0,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:54.954606 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:42:54.958759 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:42:55.028680 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-02961e95-8105-4a61-9550-4e0ebfbfd1c2 req-5a8a5d9c-9a24-4894-acb3-3e0637fa847b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 210 time: 0.1303580 Dec 09 14:42:55.145462 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51934) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:55.188595 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-635a6f96-4a13-4050-910a-82c0328cc2b9 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=27d5339e11934e85b3e5931f126faafa&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0416076 Dec 09 14:42:55.191068 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51936) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:55.282347 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4e4276a5-2848-40ee-a731-8e1806999183 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:55.307840 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4e4276a5-2848-40ee-a731-8e1806999183 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:55.372830 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4e4276a5-2848-40ee-a731-8e1806999183 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:55.375396 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4e4276a5-2848-40ee-a731-8e1806999183 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:55.379245 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-4e4276a5-2848-40ee-a731-8e1806999183 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/7ba24202-40de-488c-8005-d78ee77bab66 HTTP/1.1" status: 204 len: 168 time: 0.1844366 Dec 09 14:42:55.402238 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e4276a5-2848-40ee-a731-8e1806999183 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ba24202-40de-488c-8005-d78ee77bab66,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:55.533626 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:42:55.546526 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Sync routers for ids ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:42:55.572516 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-a9a55479-1c20-4e77-82bb-d77d7773b056 admin admin] 10.222.0.39 "PUT /v2.0/routers/55e9791c-df4d-4622-ba5c-87f71cd3c12b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 12.0597534 Dec 09 14:42:55.576545 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Router 434b7b17-3c79-4e21-9abd-a8db38cd0969 has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:42:55.584585 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Routers {'55e9791c-df4d-4622-ba5c-87f71cd3c12b'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:42:55.588129 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:42:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:55.831819 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Set router 55e9791c-df4d-4622-ba5c-87f71cd3c12b gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:42:55.894345 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 64e629a5-6b0c-4cc9-87b6-9a69a3792836 {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:42:55.921453 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51966) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:55.933212 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:42:55.946035 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Sync routers for ids ['434b7b17-3c79-4e21-9abd-a8db38cd0969'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:42:55.978533 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-0c85a4c5-4dc7-4869-89f4-ca47955e7337 admin admin] 10.222.0.39 "PUT /v2.0/routers/434b7b17-3c79-4e21-9abd-a8db38cd0969/add_router_interface HTTP/1.1" status: 200 len: 503 time: 12.8003297 Dec 09 14:42:55.987056 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:55.997290 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Routers {'434b7b17-3c79-4e21-9abd-a8db38cd0969'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:42:56.001437 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:42:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['434b7b17-3c79-4e21-9abd-a8db38cd0969'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:56.025418 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Transition to ACTIVE for port object 64e629a5-6b0c-4cc9-87b6-9a69a3792836 will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:42:56.037107 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:56.083351 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-f162704d-f884-4d7e-be05-007f5b65c2fb admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=5e3aa7dd5137453fa81be091e253a686&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1592314 Dec 09 14:42:56.084501 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 51978) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:56.095342 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Pushing event updated for resources: {'Port': ['ID=64e629a5-6b0c-4cc9-87b6-9a69a3792836,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:56.126540 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d3169c4-d816-499a-ba30-b61ab331173a req-924090a0-3f4b-42b9-9101-ee830ef0df76 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:56.135483 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0d3169c4-d816-499a-ba30-b61ab331173a req-924090a0-3f4b-42b9-9101-ee830ef0df76 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 943 time: 0.2890594 Dec 09 14:42:56.178645 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-08eceb4e-a9e0-4858-9a83-03be2c51ff0b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:56.269954 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-08eceb4e-a9e0-4858-9a83-03be2c51ff0b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:56.375199 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0d3169c4-d816-499a-ba30-b61ab331173a req-ebe5a124-d107-4b11-820a-ef2b972bb4b4 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2377043 Dec 09 14:42:56.377936 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Set router 434b7b17-3c79-4e21-9abd-a8db38cd0969 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:42:56.385613 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-08eceb4e-a9e0-4858-9a83-03be2c51ff0b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:56.389245 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-08eceb4e-a9e0-4858-9a83-03be2c51ff0b admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:56.393879 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-08eceb4e-a9e0-4858-9a83-03be2c51ff0b admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/8548e4a9-3dfa-49e8-b1d8-7b0c17087ef8 HTTP/1.1" status: 204 len: 168 time: 0.3066483 Dec 09 14:42:56.420809 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08eceb4e-a9e0-4858-9a83-03be2c51ff0b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8548e4a9-3dfa-49e8-b1d8-7b0c17087ef8,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:56.444497 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Attempting to bind port 64e629a5-6b0c-4cc9-87b6-9a69a3792836 on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:42:56.445366 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Attempting to bind port 64e629a5-6b0c-4cc9-87b6-9a69a3792836 by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': '2cc4f8a7-4cb6-4253-83d3-39c4929772e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '51590e0b-46a5-4e2e-8094-5ee83cac94b5'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:42:56.445726 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Attempting to bind port 64e629a5-6b0c-4cc9-87b6-9a69a3792836 on network 51590e0b-46a5-4e2e-8094-5ee83cac94b5 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:42:56.452243 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Port 64e629a5-6b0c-4cc9-87b6-9a69a3792836 on network 51590e0b-46a5-4e2e-8094-5ee83cac94b5 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:42:56.452593 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Attempting to bind port 64e629a5-6b0c-4cc9-87b6-9a69a3792836 on network 51590e0b-46a5-4e2e-8094-5ee83cac94b5 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:42:56.459331 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 42, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:42:56.459549 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Checking segment: {'id': '2cc4f8a7-4cb6-4253-83d3-39c4929772e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '51590e0b-46a5-4e2e-8094-5ee83cac94b5'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:56.460008 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Bound using segment: {'id': '2cc4f8a7-4cb6-4253-83d3-39c4929772e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '51590e0b-46a5-4e2e-8094-5ee83cac94b5'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:42:56.460467 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Bound port: 64e629a5-6b0c-4cc9-87b6-9a69a3792836, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2cc4f8a7-4cb6-4253-83d3-39c4929772e8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '51590e0b-46a5-4e2e-8094-5ee83cac94b5'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:42:56.460955 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:56.502296 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'ade23a8f-bc90-4df9-9f92-95d4b4587037', 'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'mac_address': 'fa:16:3e:65:b3:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 124, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 2, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'subnets': [{'id': '4b7e026c-4454-4200-91c3-30d27a976452', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:56.572486 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Checking router: 55e9791c-df4d-4622-ba5c-87f71cd3c12b for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:42:56.573102 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Updating router 55e9791c-df4d-4622-ba5c-87f71cd3c12b port ade23a8f-bc90-4df9-9f92-95d4b4587037 binding host dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:42:56.624192 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:56.696531 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27593130-5b4d-48c5-b867-5f25b1f6cc2d req-5e153811-1bda-4b1a-9941-b67d24380e58 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:56.711406 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-27593130-5b4d-48c5-b867-5f25b1f6cc2d req-5e153811-1bda-4b1a-9941-b67d24380e58 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 944 time: 0.2258804 Dec 09 14:42:56.765736 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] For port 64e629a5-6b0c-4cc9-87b6-9a69a3792836, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:42:56.816344 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] For port 64e629a5-6b0c-4cc9-87b6-9a69a3792836, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=64e629a5-6b0c-4cc9-87b6-9a69a3792836,segment=NetworkSegment(2cc4f8a7-4cb6-4253-83d3-39c4929772e8),segment_id=2cc4f8a7-4cb6-4253-83d3-39c4929772e8)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:42:56.836942 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:56.850874 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52000) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:56.876814 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-1c4bb295-da52-4e71-98a5-a88f0cb18264 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Request body: {'security_group': {'name': 'tempest-securitygroup--598611852', 'description': 'tempest-description--1615041710'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:56.954365 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1c4bb295-da52-4e71-98a5-a88f0cb18264 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.019777 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-27593130-5b4d-48c5-b867-5f25b1f6cc2d req-766c5d41-841a-4e07-8c3b-268e737c2b25 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3061171 Dec 09 14:42:57.027984 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:57.028836 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.030345 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] 10.222.0.44 "PUT /v2.0/ports/64e629a5-6b0c-4cc9-87b6-9a69a3792836 HTTP/1.1" status: 200 len: 1094 time: 3.1488404 Dec 09 14:42:57.033174 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '201d80a0-533f-4dd7-bd29-b19f9a27b094', 'tag': '64e629a5-6b0c-4cc9-87b6-9a69a3792836'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:42:57.037329 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 52004) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:57.040213 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-0f744420-32fb-4fef-97d5-3ecb6b3484fd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.088490 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83c3ad15-724a-484e-bd4d-7fd32d48489e service neutron] Pushing event updated for resources: {'Port': ['ID=64e629a5-6b0c-4cc9-87b6-9a69a3792836,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:57.091542 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'name': 'tempest-ServerRescueNegativeTestJSON-257021972-router', 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.159'}], 'enable_snat': True}, 'gw_port_id': '773a261e-796a-4ef7-b21d-e5fd6cad9fe8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:35Z', 'updated_at': '2021-12-09T14:42:51Z', 'revision_number': 4, 'project_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'gw_port': {'id': '773a261e-796a-4ef7-b21d-e5fd6cad9fe8', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:87:29:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '35277c8d-e624-48fc-97ae-fcec8459f3ca', 'name': '', 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550', 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'mac_address': 'fa:16:3e:a1:df:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'device_owner': 'network:router_interface', 'standard_attr_id': 123, 'fixed_ips': [{'subnet_id': '90388423-2d07-4cbe-80d8-fa2f6a3c14f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:52Z', 'revision_number': 2, 'project_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'subnets': [{'id': '90388423-2d07-4cbe-80d8-fa2f6a3c14f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:57.151901 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Checking router: 434b7b17-3c79-4e21-9abd-a8db38cd0969 for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:42:57.159760 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ba204feb-7ca5-4d25-9ef7-20b55f7bd1c6 req-bf28fbc8-5246-4e91-8be7-a8da32eab291 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 210 time: 0.1296940 Dec 09 14:42:57.160703 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Updating router 434b7b17-3c79-4e21-9abd-a8db38cd0969 port 35277c8d-e624-48fc-97ae-fcec8459f3ca binding host dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:42:57.223516 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.249046 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1c4bb295-da52-4e71-98a5-a88f0cb18264 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.258438 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1c4bb295-da52-4e71-98a5-a88f0cb18264 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.298600 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a0fe946c-cb98-4917-be90-ef25511d11ad admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.322608 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-524b0141-0d2d-460d-9eb9-c7f1257cbbe3" -d '{"events": [{"name": "network-changed", "server_uuid": "201d80a0-533f-4dd7-bd29-b19f9a27b094", "tag": "64e629a5-6b0c-4cc9-87b6-9a69a3792836"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:42:57.347641 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Publish callbacks [] for port, precommit_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.366768 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.387695 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c4bb295-da52-4e71-98a5-a88f0cb18264 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9a3248f4-1741-4d7a-a680-075df7d725b8,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:57.399737 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1c4bb295-da52-4e71-98a5-a88f0cb18264 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.404360 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-1c4bb295-da52-4e71-98a5-a88f0cb18264 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.5403965 Dec 09 14:42:57.407636 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52028) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:57.429096 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-0027c739-7de3-4319-b8d6-0bfbe1085d9d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Request body: {'security_group_rule': {'security_group_id': '9a3248f4-1741-4d7a-a680-075df7d725b8', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:57.500679 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0027c739-7de3-4319-b8d6-0bfbe1085d9d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.516566 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38edd768-c012-4baa-b22f-ae0a6359ff6d None None] Pushing event updated for resources: {'Port': ['ID=ade23a8f-bc90-4df9-9f92-95d4b4587037,revision_number=3']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:57.524574 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a0fe946c-cb98-4917-be90-ef25511d11ad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.533757 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a0fe946c-cb98-4917-be90-ef25511d11ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.665022 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0027c739-7de3-4319-b8d6-0bfbe1085d9d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.671912 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0027c739-7de3-4319-b8d6-0bfbe1085d9d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.698161 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-a0fe946c-cb98-4917-be90-ef25511d11ad admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=36a67de9208f43abaf0ebd11122eb815&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6573710 Dec 09 14:42:57.698799 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 52046) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:57.731927 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Attempting to bind port ade23a8f-bc90-4df9-9f92-95d4b4587037 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:42:57.732434 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Attempting to bind port ade23a8f-bc90-4df9-9f92-95d4b4587037 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:42:57.735916 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Attempting to bind port ade23a8f-bc90-4df9-9f92-95d4b4587037 on network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:42:57.738587 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0fe946c-cb98-4917-be90-ef25511d11ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6c5899e0-1b04-402c-950a-252a3be99ec2,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:57.752512 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 42, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:42:57.753359 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Checking segment: {'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109064) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:57.753913 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.754612 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Bound using segment: {'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:42:57.755478 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Bound port: ade23a8f-bc90-4df9-9f92-95d4b4587037, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'}}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:42:57.756072 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.821365 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0027c739-7de3-4319-b8d6-0bfbe1085d9d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=13ec372a-4397-46f6-939f-929930953f11,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:57.828498 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0027c739-7de3-4319-b8d6-0bfbe1085d9d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.829652 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-0027c739-7de3-4319-b8d6-0bfbe1085d9d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4206178 Dec 09 14:42:57.844499 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52050) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:57.856378 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-300866a0-aab5-48b3-a1e0-77b34871ed5b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Request body: {'security_group_rule': {'security_group_id': '9a3248f4-1741-4d7a-a680-075df7d725b8', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:57.880837 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] For port ade23a8f-bc90-4df9-9f92-95d4b4587037, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109064) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:42:57.886123 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] For port ade23a8f-bc90-4df9-9f92-95d4b4587037, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=ade23a8f-bc90-4df9-9f92-95d4b4587037,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109064) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:42:57.894963 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.908141 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-300866a0-aab5-48b3-a1e0-77b34871ed5b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:57.970946 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Routers {'55e9791c-df4d-4622-ba5c-87f71cd3c12b'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:42:57.971933 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:42:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:58.056455 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:42:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1f2c8f9d-3e9e-43ad-84ca-1e910b4fdb0c x-openstack-request-id: req-1f2c8f9d-3e9e-43ad-84ca-1e910b4fdb0c {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:42:58.058376 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-300866a0-aab5-48b3-a1e0-77b34871ed5b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:58.059561 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "201d80a0-533f-4dd7-bd29-b19f9a27b094", "tag": "64e629a5-6b0c-4cc9-87b6-9a69a3792836", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:42:58.059876 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-1f2c8f9d-3e9e-43ad-84ca-1e910b4fdb0c {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:42:58.060330 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '201d80a0-533f-4dd7-bd29-b19f9a27b094', 'tag': '64e629a5-6b0c-4cc9-87b6-9a69a3792836', 'status': 'completed', 'code': 200} Dec 09 14:42:58.060965 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-479f20bd-3042-4d95-ab98-dc33d88bd553 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:58.075182 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Publish callbacks [] for port, precommit_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:58.082245 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-300866a0-aab5-48b3-a1e0-77b34871ed5b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:58.090120 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:58.111977 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38edd768-c012-4baa-b22f-ae0a6359ff6d None None] Pushing event updated for resources: {'Port': ['ID=ade23a8f-bc90-4df9-9f92-95d4b4587037,revision_number=4']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:58.122661 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-42ed9c91-c877-4065-9770-69a014e83b4c None None] Provisioning complete for port ade23a8f-bc90-4df9-9f92-95d4b4587037 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:58.122932 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-42ed9c91-c877-4065-9770-69a014e83b4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:58.140809 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-5625a43b-3616-4f5c-a8f0-e78e6c8cc8c9 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:58.157300 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-5625a43b-3616-4f5c-a8f0-e78e6c8cc8c9 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/networks?id=8ff38a1e-5122-4806-8b7d-d4c281cbe550 HTTP/1.1" status: 200 len: 818 time: 0.4574454 Dec 09 14:42:58.195555 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-650c9df7-2cad-4583-bcf3-bd12effdb680 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/quotas/3d298e3ebec54c2281ddf8bbb50b7cea HTTP/1.1" status: 200 len: 375 time: 0.0369585 Dec 09 14:42:58.280543 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-300866a0-aab5-48b3-a1e0-77b34871ed5b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fcc94d62-83d0-44d8-a39d-e078b0714f6a,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:58.281136 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-479f20bd-3042-4d95-ab98-dc33d88bd553 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:58.305433 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] Set router 55e9791c-df4d-4622-ba5c-87f71cd3c12b gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:42:58.363413 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-42ed9c91-c877-4065-9770-69a014e83b4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:58.414009 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fff463bd-a432-4e69-a63d-38a4415c8151 None None] Pushing event updated for resources: {'Port': ['ID=35277c8d-e624-48fc-97ae-fcec8459f3ca,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:58.434544 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-35cc8581-258f-47eb-8624-069dffd9d6d4 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=3d298e3ebec54c2281ddf8bbb50b7cea&fields=id HTTP/1.1" status: 200 len: 255 time: 0.2376916 Dec 09 14:42:58.442434 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-42ed9c91-c877-4065-9770-69a014e83b4c None None] For port ade23a8f-bc90-4df9-9f92-95d4b4587037, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=ade23a8f-bc90-4df9-9f92-95d4b4587037,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:42:58.459933 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Attempting to bind port 35277c8d-e624-48fc-97ae-fcec8459f3ca on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:42:58.460586 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Attempting to bind port 35277c8d-e624-48fc-97ae-fcec8459f3ca by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': '7ece4ded-a169-4d54-b911-54a5a65cd0ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:42:58.461103 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Attempting to bind port 35277c8d-e624-48fc-97ae-fcec8459f3ca on network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:42:58.467417 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 42, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:42:58.468047 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Checking segment: {'id': '7ece4ded-a169-4d54-b911-54a5a65cd0ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:42:58.468592 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:58.469114 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Bound using segment: {'id': '7ece4ded-a169-4d54-b911-54a5a65cd0ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:42:58.469749 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Bound port: 35277c8d-e624-48fc-97ae-fcec8459f3ca, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7ece4ded-a169-4d54-b911-54a5a65cd0ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:42:58.470272 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:58.472394 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-42ed9c91-c877-4065-9770-69a014e83b4c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:58.530029 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-524b0141-0d2d-460d-9eb9-c7f1257cbbe3 req-b998cacc-a8f9-49e3-9a8b-b8c5c795f3dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:58.531929 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-524b0141-0d2d-460d-9eb9-c7f1257cbbe3 req-b998cacc-a8f9-49e3-9a8b-b8c5c795f3dd service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=1c1fb4e2e42c41e6bfff5cb72fe05656&device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 1097 time: 0.3558397 Dec 09 14:42:58.576956 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42ed9c91-c877-4065-9770-69a014e83b4c None None] Pushing event updated for resources: {'Port': ['ID=ade23a8f-bc90-4df9-9f92-95d4b4587037,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:58.643185 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5b33869c-8a0b-475b-b1b3-13801000153f None None] Provisioning complete for port ade23a8f-bc90-4df9-9f92-95d4b4587037 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:42:58.643586 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5b33869c-8a0b-475b-b1b3-13801000153f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:58.646387 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] For port 35277c8d-e624-48fc-97ae-fcec8459f3ca, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:42:58.652729 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-479f20bd-3042-4d95-ab98-dc33d88bd553 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:58.656500 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-479f20bd-3042-4d95-ab98-dc33d88bd553 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:58.658393 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-479f20bd-3042-4d95-ab98-dc33d88bd553 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/6c5899e0-1b04-402c-950a-252a3be99ec2 HTTP/1.1" status: 204 len: 168 time: 0.9570928 Dec 09 14:42:58.715440 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] For port 35277c8d-e624-48fc-97ae-fcec8459f3ca, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=35277c8d-e624-48fc-97ae-fcec8459f3ca,segment=NetworkSegment(7ece4ded-a169-4d54-b911-54a5a65cd0ce),segment_id=7ece4ded-a169-4d54-b911-54a5a65cd0ce)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:42:58.742475 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:58.888036 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'ade23a8f-bc90-4df9-9f92-95d4b4587037', 'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'mac_address': 'fa:16:3e:65:b3:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 124, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:57Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'subnets': [{'id': '4b7e026c-4454-4200-91c3-30d27a976452', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:58.927144 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-524b0141-0d2d-460d-9eb9-c7f1257cbbe3 req-1df24972-adcc-40eb-805f-8b6ca2288aeb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:58.928297 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-220c155f-c6db-4d23-af72-69ea33d351f1 None None] The sync data for ids ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'] in dv-cinder-819692-8-iscsi is: [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'ade23a8f-bc90-4df9-9f92-95d4b4587037', 'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'mac_address': 'fa:16:3e:65:b3:12', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 124, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:57Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'subnets': [{'id': '4b7e026c-4454-4200-91c3-30d27a976452', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:42:58.932991 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-524b0141-0d2d-460d-9eb9-c7f1257cbbe3 req-1df24972-adcc-40eb-805f-8b6ca2288aeb service neutron] 10.222.0.44 "GET /v2.0/networks?tenant_id=1c1fb4e2e42c41e6bfff5cb72fe05656&shared=False HTTP/1.1" status: 200 len: 912 time: 0.3902864 Dec 09 14:42:58.937834 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.44', 63448) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:58.958922 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-479f20bd-3042-4d95-ab98-dc33d88bd553 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6c5899e0-1b04-402c-950a-252a3be99ec2,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:59.000271 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fff463bd-a432-4e69-a63d-38a4415c8151 None None] Pushing event updated for resources: {'Port': ['ID=35277c8d-e624-48fc-97ae-fcec8459f3ca,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:59.022943 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Routers {'434b7b17-3c79-4e21-9abd-a8db38cd0969'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:42:59.024464 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:42:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['434b7b17-3c79-4e21-9abd-a8db38cd0969'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:59.097162 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-125f376b-b091-44d0-9491-29d831e4f6ee req-5aededa2-ccfb-47a1-91da-d0ccf43e2654 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:59.098912 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-125f376b-b091-44d0-9491-29d831e4f6ee req-5aededa2-ccfb-47a1-91da-d0ccf43e2654 service neutron] 10.222.0.44 "GET /v2.0/networks?tenant_id=5ec989b7fd3e45f2b8962e012b0797ac&shared=False HTTP/1.1" status: 200 len: 916 time: 1.0308192 Dec 09 14:42:59.145756 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-300866a0-aab5-48b3-a1e0-77b34871ed5b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:59.147175 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-300866a0-aab5-48b3-a1e0-77b34871ed5b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.3008938 Dec 09 14:42:59.177018 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 52080) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:59.296809 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f605fd7-6a0f-41dd-9e4a-d35f7f685c0a req-a15b5b64-9de5-4102-973c-ad76d23d9d3c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:59.303712 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-71ddf578-cc37-4680-b090-c93852ada8f6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:59.305279 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8f605fd7-6a0f-41dd-9e4a-d35f7f685c0a req-a15b5b64-9de5-4102-973c-ad76d23d9d3c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 943 time: 0.9909618 Dec 09 14:42:59.316308 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52086) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:59.345621 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] Set router 434b7b17-3c79-4e21-9abd-a8db38cd0969 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:42:59.355374 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-031a918d-bbd5-47c5-9a3a-b69245d02c57 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:59.455944 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Request body: {'floatingip': {'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:42:59.486131 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-05d68dbe-7274-4027-8dce-f7412b3aac96 service neutron] 10.222.0.39 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.0504005 Dec 09 14:42:59.492245 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8f605fd7-6a0f-41dd-9e4a-d35f7f685c0a req-53548bd3-a6a8-4c2d-8e17-1b70f36b62ce tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1848826 Dec 09 14:42:59.508730 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-125f376b-b091-44d0-9491-29d831e4f6ee req-f9ccb2d0-afb2-4569-82c8-0f4a44427474 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:59.510332 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-125f376b-b091-44d0-9491-29d831e4f6ee req-f9ccb2d0-afb2-4569-82c8-0f4a44427474 service neutron] 10.222.0.44 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3965440 Dec 09 14:42:59.678755 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-031a918d-bbd5-47c5-9a3a-b69245d02c57 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:59.724905 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-031a918d-bbd5-47c5-9a3a-b69245d02c57 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:59.777403 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'name': 'tempest-ServerRescueNegativeTestJSON-257021972-router', 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.159'}], 'enable_snat': True}, 'gw_port_id': '773a261e-796a-4ef7-b21d-e5fd6cad9fe8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:35Z', 'updated_at': '2021-12-09T14:42:51Z', 'revision_number': 4, 'project_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'gw_port': {'id': '773a261e-796a-4ef7-b21d-e5fd6cad9fe8', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:87:29:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '35277c8d-e624-48fc-97ae-fcec8459f3ca', 'name': '', 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550', 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'mac_address': 'fa:16:3e:a1:df:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'device_owner': 'network:router_interface', 'standard_attr_id': 123, 'fixed_ips': [{'subnet_id': '90388423-2d07-4cbe-80d8-fa2f6a3c14f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:58Z', 'revision_number': 4, 'project_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'subnets': [{'id': '90388423-2d07-4cbe-80d8-fa2f6a3c14f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:42:59.794430 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-4e6e816c-f836-4ad3-89c2-02df776faddf tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:59.796023 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-4e6e816c-f836-4ad3-89c2-02df776faddf tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.44 "GET /v2.0/networks?id=9ab3f8b6-44d0-4210-907d-0e96072c4566 HTTP/1.1" status: 200 len: 816 time: 0.8496721 Dec 09 14:42:59.800848 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ce9953-959c-498b-a239-cba26d7d473e req-c9a669f5-542b-4b43-a3b7-93ed7735f660 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:59.802607 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-c9a669f5-542b-4b43-a3b7-93ed7735f660 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=5ec989b7fd3e45f2b8962e012b0797ac&device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 1096 time: 0.1149998 Dec 09 14:42:59.824988 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-031a918d-bbd5-47c5-9a3a-b69245d02c57 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=fa36a59ce99b4c099dbcb59f372749e7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5021205 Dec 09 14:42:59.832554 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-031a918d-bbd5-47c5-9a3a-b69245d02c57 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=21d40ffa-5781-49ce-b030-d5ba0a7b74c5,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:42:59.848521 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 52102) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:42:59.912903 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-a8c6b05d-4004-4034-899f-16259720f150 service neutron] 10.222.0.39 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4259579 Dec 09 14:42:59.914094 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for floatingip, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:42:59.921959 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-e8153f19-ebcc-433e-bdd5-c49d8985c71b service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=746ea6aa-be43-4fbf-9463-02d741db305a HTTP/1.1" status: 200 len: 217 time: 0.1005108 Dec 09 14:42:59.985593 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf0a92c-b4fc-440e-9893-494a2c4061b8 req-d50a0a24-0fae-4399-b4a3-fa82fc44a495 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:42:59.998631 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-524b0141-0d2d-460d-9eb9-c7f1257cbbe3 req-f2873b49-8ce5-41d5-b4f4-17b6cbba1728 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:00.000263 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-524b0141-0d2d-460d-9eb9-c7f1257cbbe3 req-f2873b49-8ce5-41d5-b4f4-17b6cbba1728 service neutron] 10.222.0.44 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 1.0187888 Dec 09 14:43:00.009252 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6d2a3ed3-00ce-4cfd-bb49-bba40c57cdb2 None None] The sync data for ids ['434b7b17-3c79-4e21-9abd-a8db38cd0969'] in dv-cinder-819692-8-iscsi is: [{'id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'name': 'tempest-ServerRescueNegativeTestJSON-257021972-router', 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.159'}], 'enable_snat': True}, 'gw_port_id': '773a261e-796a-4ef7-b21d-e5fd6cad9fe8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:35Z', 'updated_at': '2021-12-09T14:42:51Z', 'revision_number': 4, 'project_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'gw_port': {'id': '773a261e-796a-4ef7-b21d-e5fd6cad9fe8', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:87:29:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '35277c8d-e624-48fc-97ae-fcec8459f3ca', 'name': '', 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550', 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'mac_address': 'fa:16:3e:a1:df:b9', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'device_owner': 'network:router_interface', 'standard_attr_id': 123, 'fixed_ips': [{'subnet_id': '90388423-2d07-4cbe-80d8-fa2f6a3c14f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:58Z', 'revision_number': 4, 'project_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'subnets': [{'id': '90388423-2d07-4cbe-80d8-fa2f6a3c14f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:43:00.019233 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4cf0a92c-b4fc-440e-9893-494a2c4061b8 req-d50a0a24-0fae-4399-b4a3-fa82fc44a495 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 944 time: 0.2568822 Dec 09 14:43:00.190244 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7ce9953-959c-498b-a239-cba26d7d473e req-742fd10e-c4d3-4ea0-9561-b17dd9b3ce83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:00.192025 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-742fd10e-c4d3-4ea0-9561-b17dd9b3ce83 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=7c6b4bb0-bfec-44d0-8503-70917540b3c5 HTTP/1.1" status: 200 len: 855 time: 0.2622595 Dec 09 14:43:00.221631 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4cf0a92c-b4fc-440e-9893-494a2c4061b8 req-0a8ab7e0-186d-4a0e-954a-4ba5ac5d81bb tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2011919 Dec 09 14:43:00.227820 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4be88cd6-45cc-4f93-a0c3-cb9c7df62af9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:00.298811 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-3e773751-8dae-4747-9ac7-7ca33ea7a17e service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0758703 Dec 09 14:43:00.404229 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b9b513f1-0ccc-4e2f-829d-cb0aeadb1f37 req-8689419c-05b7-4160-9407-49bb9bb5ccd3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 210 time: 0.0925410 Dec 09 14:43:00.422458 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:00.473344 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4be88cd6-45cc-4f93-a0c3-cb9c7df62af9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:00.495723 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-3a43d0aa-7c38-4781-b709-877d72f442cb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.44 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6be5d78d2d0049448c3947b4e650758a HTTP/1.1" status: 200 len: 380 time: 0.6734304 Dec 09 14:43:00.504392 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-2f2ccf4c-d642-4d83-827b-3808b1bc1756 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:00.506371 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-2f2ccf4c-d642-4d83-827b-3808b1bc1756 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=1c1fb4e2e42c41e6bfff5cb72fe05656&device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 1097 time: 0.4505990 Dec 09 14:43:00.513470 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-9aacfa9b-b015-414d-a9d3-caf8df0863be req-f0f56c44-0138-4670-8a51-16fdde1ba3db tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 210 time: 0.0718594 Dec 09 14:43:00.519152 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-4796fb29-52dc-4ffd-b09f-d75c6ed9dd3d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Request body: {'port': {'device_id': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'admin_state_up': True, 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'security_groups': ['0305423b-9ab7-48eb-b33a-bd8e33378735']}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:00.531644 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-1d9e49af-c759-49c5-a86a-a25380c79d0c service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2251072 Dec 09 14:43:00.766047 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-dc6b3e0a-92e1-4c0e-b8fd-6a1f7f36fb27 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=64e629a5-6b0c-4cc9-87b6-9a69a3792836 HTTP/1.1" status: 200 len: 217 time: 0.1091781 Dec 09 14:43:00.826751 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-4796fb29-52dc-4ffd-b09f-d75c6ed9dd3d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Made reservation on behalf of 6be5d78d2d0049448c3947b4e650758a for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:43:00.830423 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-4796fb29-52dc-4ffd-b09f-d75c6ed9dd3d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:00.854844 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e48a6ac0-6a64-4a8c-a746-36e7df7daf23 req-58ba4870-6b39-4332-935c-7e8b25721826 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:00.856616 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e48a6ac0-6a64-4a8c-a746-36e7df7daf23 req-58ba4870-6b39-4332-935c-7e8b25721826 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 943 time: 0.1756825 Dec 09 14:43:00.937326 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4be88cd6-45cc-4f93-a0c3-cb9c7df62af9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:00.940449 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4be88cd6-45cc-4f93-a0c3-cb9c7df62af9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:00.941803 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-4be88cd6-45cc-4f93-a0c3-cb9c7df62af9 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/21d40ffa-5781-49ce-b030-d5ba0a7b74c5 HTTP/1.1" status: 204 len: 168 time: 1.0785880 Dec 09 14:43:00.975814 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d7ce9953-959c-498b-a239-cba26d7d473e req-9cf97a9a-b564-458b-8a75-3f5fac20444d service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4319596 Dec 09 14:43:01.005931 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e48a6ac0-6a64-4a8c-a746-36e7df7daf23 req-85951d98-ab63-49a8-a516-a6714fc290f7 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1365082 Dec 09 14:43:01.062969 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device ade23a8f-bc90-4df9-9f92-95d4b4587037 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:43:01.105827 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-653a0c08-2a1f-489b-b382-7cf2312e6bea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:01.107482 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-653a0c08-2a1f-489b-b382-7cf2312e6bea service neutron] 10.222.0.44 "GET /v2.0/subnets?id=ae0e8ccb-a0a9-4f5b-93f6-77fb4806d03e HTTP/1.1" status: 200 len: 851 time: 0.3330736 Dec 09 14:43:01.110656 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4be88cd6-45cc-4f93-a0c3-cb9c7df62af9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=21d40ffa-5781-49ce-b030-d5ba0a7b74c5,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:01.145604 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:01.161400 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port ade23a8f-bc90-4df9-9f92-95d4b4587037 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:01.161947 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:01.265787 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 35277c8d-e624-48fc-97ae-fcec8459f3ca up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:43:01.297724 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-bed251e4-5fda-4ecb-be45-40af680f7ea2 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=51590e0b-46a5-4e2e-8094-5ee83cac94b5&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1582062 Dec 09 14:43:01.351879 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 35277c8d-e624-48fc-97ae-fcec8459f3ca triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:01.353631 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:01.471231 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b13a9da8-75eb-4e9b-87f1-6a55c3aa65a9 req-843af751-24a0-410f-8fd0-8f9d2c75ee96 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:01.472833 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b13a9da8-75eb-4e9b-87f1-6a55c3aa65a9 req-843af751-24a0-410f-8fd0-8f9d2c75ee96 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 944 time: 0.0854578 Dec 09 14:43:01.488875 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:01.529138 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] For port 35277c8d-e624-48fc-97ae-fcec8459f3ca, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=35277c8d-e624-48fc-97ae-fcec8459f3ca,segment=NetworkSegment(7ece4ded-a169-4d54-b911-54a5a65cd0ce),segment_id=7ece4ded-a169-4d54-b911-54a5a65cd0ce)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:01.535363 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:01.574947 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b13a9da8-75eb-4e9b-87f1-6a55c3aa65a9 req-94f975ea-950b-4410-b612-dd729d0f8ad1 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0954549 Dec 09 14:43:01.639227 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Pushing event updated for resources: {'Port': ['ID=35277c8d-e624-48fc-97ae-fcec8459f3ca,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:01.691913 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-26a92e06-f9d7-408f-b767-79957054d484 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:01.700556 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-26a92e06-f9d7-408f-b767-79957054d484 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/networks?id=8ff38a1e-5122-4806-8b7d-d4c281cbe550 HTTP/1.1" status: 200 len: 818 time: 0.7745378 Dec 09 14:43:01.750749 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-4796fb29-52dc-4ffd-b09f-d75c6ed9dd3d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Allocated IP 172.20.0.14 (9ab3f8b6-44d0-4210-907d-0e96072c4566/f10f1097-5d43-4737-bcac-a27ade66b442/eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:43:01.781156 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Allocated IP 172.27.0.16 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/ef9a7156-f6f9-4f11-bac3-da1e7ccfd754) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:43:01.797220 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-70e3bc36-27f5-43ac-b3f4-fddc83f68549 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/quotas/3d298e3ebec54c2281ddf8bbb50b7cea HTTP/1.1" status: 200 len: 375 time: 0.0940375 Dec 09 14:43:01.798772 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:01.802096 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-ec942df5-5f7e-41aa-917e-821d925073b5 service neutron] 10.222.0.44 "GET /v2.0/networks/51590e0b-46a5-4e2e-8094-5ee83cac94b5?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4882882 Dec 09 14:43:01.991452 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3f67a2c3-6720-4311-8d01-cf3794dee345 req-22237f02-4215-43bb-bd2b-d0f6c605dd18 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 210 time: 0.0608902 Dec 09 14:43:02.122604 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-095af91d-b3ae-4197-90c2-cece89f4596e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=3d298e3ebec54c2281ddf8bbb50b7cea&fields=id HTTP/1.1" status: 200 len: 255 time: 0.3260443 Dec 09 14:43:02.142887 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-e1f128d9-d8e6-4eb3-8bbf-62e4a8cc59c0 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:02.144416 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-e1f128d9-d8e6-4eb3-8bbf-62e4a8cc59c0 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.44 "GET /v2.0/networks?id=8ff38a1e-5122-4806-8b7d-d4c281cbe550 HTTP/1.1" status: 200 len: 818 time: 0.3659804 Dec 09 14:43:02.172117 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-b8dc7ccf-9303-4148-9193-edecb02f56cb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Request body: {'port': {'device_id': '41c03279-323a-43f0-94a0-92862c30a78a', 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550', 'admin_state_up': True, 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:02.232386 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e08c65dc-6fad-4815-bf84-10ec456f4d33 req-c9eb6855-3f3a-4ade-9ccd-45610d38d977 service neutron] 10.222.0.44 "GET /v2.0/networks/51590e0b-46a5-4e2e-8094-5ee83cac94b5?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4121866 Dec 09 14:43:02.261872 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a0f406-774b-44be-a742-e427bf43c2a6 req-efb80b7a-3bc2-4069-87e2-3506de00b06e tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:02.272498 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f5a0f406-774b-44be-a742-e427bf43c2a6 req-efb80b7a-3bc2-4069-87e2-3506de00b06e tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 943 time: 0.1376996 Dec 09 14:43:02.350751 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f5a0f406-774b-44be-a742-e427bf43c2a6 req-dc61cc8d-1d6b-4f84-b13e-7f49e4efbee9 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0764496 Dec 09 14:43:02.367119 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-b8dc7ccf-9303-4148-9193-edecb02f56cb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Made reservation on behalf of 3d298e3ebec54c2281ddf8bbb50b7cea for: {'port': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:43:02.371862 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-b8dc7ccf-9303-4148-9193-edecb02f56cb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:02.502516 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:02.508519 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-b8dc7ccf-9303-4148-9193-edecb02f56cb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Allocated IP 172.20.0.3 (8ff38a1e-5122-4806-8b7d-d4c281cbe550/90388423-2d07-4cbe-80d8-fa2f6a3c14f7/bb290a6d-709a-49d1-bd2e-10c0fe664657) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:43:02.513522 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-4796fb29-52dc-4ffd-b09f-d75c6ed9dd3d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:02.541813 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-6ee8360c-8f67-4a4e-8c15-5ba83e4e2b72 service neutron] 10.222.0.39 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4183085 Dec 09 14:43:02.635418 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:02.636146 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:02.644321 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-4796fb29-52dc-4ffd-b09f-d75c6ed9dd3d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:02.720436 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:43:02.735426 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-4796fb29-52dc-4ffd-b09f-d75c6ed9dd3d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Network 9ab3f8b6-44d0-4210-907d-0e96072c4566 is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:43:02.736452 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:43:02.737304 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-912d0c39-8080-4b26-b40e-4b45f0a52025 req-c9f103ec-6e44-43dc-b02b-0cc55452d36f tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:02.738930 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-912d0c39-8080-4b26-b40e-4b45f0a52025 req-c9f103ec-6e44-43dc-b02b-0cc55452d36f tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 944 time: 0.0858312 Dec 09 14:43:02.739057 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:43:02.744401 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event updated for resources: {'Port': ['ID=ef9a7156-f6f9-4f11-bac3-da1e7ccfd754,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:02.764134 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-b8dc7ccf-9303-4148-9193-edecb02f56cb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:02.767860 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-4796fb29-52dc-4ffd-b09f-d75c6ed9dd3d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:43:02.770488 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-4796fb29-52dc-4ffd-b09f-d75c6ed9dd3d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:43:02.778812 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-95333f38-8931-4694-807e-e953d5b186b4 service neutron] 10.222.0.39 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2291379 Dec 09 14:43:02.878791 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-912d0c39-8080-4b26-b40e-4b45f0a52025 req-ff52e83e-120c-4c72-8d72-0c3070bb46b2 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1275597 Dec 09 14:43:02.881068 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-b8dc7ccf-9303-4148-9193-edecb02f56cb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:02.966992 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8dc7ccf-9303-4148-9193-edecb02f56cb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Pushing event updated for resources: {'Port': ['ID=bb290a6d-709a-49d1-bd2e-10c0fe664657,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:02.969628 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4796fb29-52dc-4ffd-b09f-d75c6ed9dd3d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event updated for resources: {'Port': ['ID=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:03.000026 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-b8dc7ccf-9303-4148-9193-edecb02f56cb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:43:03.005279 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-b8dc7ccf-9303-4148-9193-edecb02f56cb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:43:03.013092 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-b8dc7ccf-9303-4148-9193-edecb02f56cb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:43:03.059701 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 35277c8d-e624-48fc-97ae-fcec8459f3ca up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:43:03.140564 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-b8dc7ccf-9303-4148-9193-edecb02f56cb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:03.141388 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-b8dc7ccf-9303-4148-9193-edecb02f56cb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for port, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:03.142228 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-4796fb29-52dc-4ffd-b09f-d75c6ed9dd3d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:03.145389 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-4796fb29-52dc-4ffd-b09f-d75c6ed9dd3d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:03.195966 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-b8dc7ccf-9303-4148-9193-edecb02f56cb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0367303 Dec 09 14:43:03.217151 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Request body: {'port': {'device_id': '41c03279-323a-43f0-94a0-92862c30a78a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:03.240010 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 35277c8d-e624-48fc-97ae-fcec8459f3ca triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:03.240451 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:03.263154 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-97b7f1d3-826e-4946-acf1-2c3a51be826b None None] Provisioning complete for port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:03.263513 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-97b7f1d3-826e-4946-acf1-2c3a51be826b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:03.268451 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 746ea6aa-be43-4fbf-9463-02d741db305a details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:43:03.292350 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-4796fb29-52dc-4ffd-b09f-d75c6ed9dd3d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.7806420 Dec 09 14:43:03.339472 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Request body: {'port': {'device_id': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:03.467980 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-97b7f1d3-826e-4946-acf1-2c3a51be826b None None] Port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:43:03.507599 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:03.543272 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a402fd0a-4572-494b-9e5a-90eabef42fb3 req-cef2ee61-9ef0-4359-9d2a-4c86cc920c61 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 210 time: 0.2764173 Dec 09 14:43:03.621482 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 746ea6aa-be43-4fbf-9463-02d741db305a, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=746ea6aa-be43-4fbf-9463-02d741db305a,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:03.643189 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': '746ea6aa-be43-4fbf-9463-02d741db305a', 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d', 'port_id': '746ea6aa-be43-4fbf-9463-02d741db305a', 'mac_address': 'fa:16:3e:b6:05:5c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 405, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7c6b4bb0-bfec-44d0-8503-70917540b3c5', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:43:03.690268 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4507952d-164c-43fb-9c38-4daee20c0970 req-f42ed9c8-f358-4278-a387-f936f19f4077 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:03.698095 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4507952d-164c-43fb-9c38-4daee20c0970 req-f42ed9c8-f358-4278-a387-f936f19f4077 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 932 time: 0.1607449 Dec 09 14:43:03.699831 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:03.702528 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:03.724813 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:03.745652 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 746ea6aa-be43-4fbf-9463-02d741db305a {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:43:03.772316 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 746ea6aa-be43-4fbf-9463-02d741db305a, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=746ea6aa-be43-4fbf-9463-02d741db305a,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:03.772569 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:03.785549 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:03.786533 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 64e629a5-6b0c-4cc9-87b6-9a69a3792836 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:43:03.804261 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4507952d-164c-43fb-9c38-4daee20c0970 req-3cdedd01-f994-4ad1-a9ef-da9a366d2096 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1051328 Dec 09 14:43:03.952096 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=746ea6aa-be43-4fbf-9463-02d741db305a,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:04.028167 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 64e629a5-6b0c-4cc9-87b6-9a69a3792836, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=64e629a5-6b0c-4cc9-87b6-9a69a3792836,segment=NetworkSegment(2cc4f8a7-4cb6-4253-83d3-39c4929772e8),segment_id=2cc4f8a7-4cb6-4253-83d3-39c4929772e8)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:04.046682 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': '64e629a5-6b0c-4cc9-87b6-9a69a3792836', 'network_id': '51590e0b-46a5-4e2e-8094-5ee83cac94b5', 'port_id': '64e629a5-6b0c-4cc9-87b6-9a69a3792836', 'mac_address': 'fa:16:3e:1c:50:56', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 400, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ae0e8ccb-a0a9-4f5b-93f6-77fb4806d03e', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:43:04.074170 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb371795-2582-4239-84b1-b81199dc95e6 req-15f598e0-0d90-4938-b94f-3380103c7f87 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:04.076219 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fb371795-2582-4239-84b1-b81199dc95e6 req-15f598e0-0d90-4938-b94f-3380103c7f87 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 943 time: 0.3794923 Dec 09 14:43:04.091536 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.105584 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 64e629a5-6b0c-4cc9-87b6-9a69a3792836 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:43:04.127120 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdfa9432-5a8c-4759-9529-94eeb8a25e62 req-e76e6c26-8091-4433-97de-63dad85eb37a tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:04.128628 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fdfa9432-5a8c-4759-9529-94eeb8a25e62 req-e76e6c26-8091-4433-97de-63dad85eb37a tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 944 time: 0.0819173 Dec 09 14:43:04.129897 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 64e629a5-6b0c-4cc9-87b6-9a69a3792836, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=64e629a5-6b0c-4cc9-87b6-9a69a3792836,segment=NetworkSegment(2cc4f8a7-4cb6-4253-83d3-39c4929772e8),segment_id=2cc4f8a7-4cb6-4253-83d3-39c4929772e8)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:04.140870 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.190614 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=64e629a5-6b0c-4cc9-87b6-9a69a3792836,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:04.218661 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fdfa9432-5a8c-4759-9529-94eeb8a25e62 req-c309fe0e-ffdf-46fa-a6d6-7e64961de6c4 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0793467 Dec 09 14:43:04.226804 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.notifiers.nova [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bb290a6d-709a-49d1-bd2e-10c0fe664657 {{(pid=109062) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:43:04.229429 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fb371795-2582-4239-84b1-b81199dc95e6 req-561433e1-5742-4f96-bb61-426b1cc30e5d tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1439385 Dec 09 14:43:04.236311 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.252087 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.provisioning_blocks [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Transition to ACTIVE for port object bb290a6d-709a-49d1-bd2e-10c0fe664657 will not be triggered until provisioned by entity L2. {{(pid=109062) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:43:04.258383 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-130461426'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.306592 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.309812 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Pushing event updated for resources: {'Port': ['ID=bb290a6d-709a-49d1-bd2e-10c0fe664657,revision_number=2']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:04.311494 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:43:04.317873 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.323267 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.373993 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Transition to ACTIVE for port object eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:43:04.398267 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.399848 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.managers [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Attempting to bind port bb290a6d-709a-49d1-bd2e-10c0fe664657 on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109062) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:43:04.400469 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.managers [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Attempting to bind port bb290a6d-709a-49d1-bd2e-10c0fe664657 by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': '7ece4ded-a169-4d54-b911-54a5a65cd0ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550'}] {{(pid=109062) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:43:04.401069 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Attempting to bind port bb290a6d-709a-49d1-bd2e-10c0fe664657 on network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 {{(pid=109062) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:43:04.407228 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Port bb290a6d-709a-49d1-bd2e-10c0fe664657 on network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109062) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:43:04.407684 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Attempting to bind port bb290a6d-709a-49d1-bd2e-10c0fe664657 on network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 {{(pid=109062) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:43:04.409838 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event updated for resources: {'Port': ['ID=ef9a7156-f6f9-4f11-bac3-da1e7ccfd754,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:04.415339 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 42, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109062) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:43:04.415339 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Checking segment: {'id': '7ece4ded-a169-4d54-b911-54a5a65cd0ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109062) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:43:04.416051 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Bound using segment: {'id': '7ece4ded-a169-4d54-b911-54a5a65cd0ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550'} {{(pid=109062) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:43:04.416664 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.managers [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Bound port: bb290a6d-709a-49d1-bd2e-10c0fe664657, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7ece4ded-a169-4d54-b911-54a5a65cd0ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550'}}] {{(pid=109062) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:43:04.417186 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.466282 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.480336 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Pushing event updated for resources: {'Port': ['ID=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:04.490083 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.db [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] For port bb290a6d-709a-49d1-bd2e-10c0fe664657, host hv-cinder-81969, cleared binding levels {{(pid=109062) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:43:04.498246 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.db [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] For port bb290a6d-709a-49d1-bd2e-10c0fe664657, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=bb290a6d-709a-49d1-bd2e-10c0fe664657,segment=NetworkSegment(7ece4ded-a169-4d54-b911-54a5a65cd0ce),segment_id=7ece4ded-a169-4d54-b911-54a5a65cd0ce)] {{(pid=109062) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:43:04.504076 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-130461426'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.511031 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.512346 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-52be8911-0f4e-4cfe-bf21-ed870ed2b331 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 5.3335083 Dec 09 14:43:04.560379 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:04.561023 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for port, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.562102 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Attempting to bind port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:43:04.562452 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Attempting to bind port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:43:04.562791 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Attempting to bind port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 on network 9ab3f8b6-44d0-4210-907d-0e96072c4566 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:43:04.563237 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] 10.222.0.44 "PUT /v2.0/ports/bb290a6d-709a-49d1-bd2e-10c0fe664657 HTTP/1.1" status: 200 len: 1093 time: 1.3615577 Dec 09 14:43:04.563856 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '41c03279-323a-43f0-94a0-92862c30a78a', 'tag': 'bb290a6d-709a-49d1-bd2e-10c0fe664657'}] {{(pid=109062) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:04.566470 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3f1ec408b0eec5a36b56e0a757eff0f4875d9a95eff62f4d0b4a62bb27a3b600" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-342cee1c-c27c-435b-89d1-7a34c74b7d0e" -d '{"events": [{"name": "network-changed", "server_uuid": "41c03279-323a-43f0-94a0-92862c30a78a", "tag": "bb290a6d-709a-49d1-bd2e-10c0fe664657"}]}' {{(pid=109062) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:04.573478 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 on network 9ab3f8b6-44d0-4210-907d-0e96072c4566 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:43:04.573770 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Attempting to bind port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 on network 9ab3f8b6-44d0-4210-907d-0e96072c4566 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:43:04.580989 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 42, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:43:04.581336 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Checking segment: {'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:43:04.581963 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Bound using segment: {'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:43:04.582698 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Bound port: eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:43:04.583674 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.608045 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49326cdf-018c-432a-8656-7b053c745a40 service neutron] Pushing event updated for resources: {'Port': ['ID=bb290a6d-709a-49d1-bd2e-10c0fe664657,revision_number=3']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:04.668540 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] For port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:43:04.672600 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] For port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:43:04.677940 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.700725 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a842bc7a-4596-4321-b1b9-8c935fc935ff req-a5b752bb-2151-486e-9dd9-066f0057a235 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 210 time: 0.0466888 Dec 09 14:43:04.718044 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fd971423-6a18-45fe-bc3a-d8ce23335f15 x-openstack-request-id: req-fd971423-6a18-45fe-bc3a-d8ce23335f15 {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:04.718609 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "41c03279-323a-43f0-94a0-92862c30a78a", "tag": "bb290a6d-709a-49d1-bd2e-10c0fe664657", "status": "completed", "code": 200}]} {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:04.719066 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-fd971423-6a18-45fe-bc3a-d8ce23335f15 {{(pid=109062) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:04.719782 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '41c03279-323a-43f0-94a0-92862c30a78a', 'tag': 'bb290a6d-709a-49d1-bd2e-10c0fe664657', 'status': 'completed', 'code': 200} Dec 09 14:43:04.741823 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:04.743007 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:04.744354 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] 10.222.0.44 "PUT /v2.0/ports/eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 HTTP/1.1" status: 200 len: 1094 time: 1.4158185 Dec 09 14:43:04.744814 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'tag': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:04.754214 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0736eb7a-989b-42b3-8c2a-77e1152d5925" -d '{"events": [{"name": "network-changed", "server_uuid": "a8ee2ec0-d1d7-458d-ae2a-509098efff13", "tag": "eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:04.779842 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b61008a-150b-4f4d-a593-7a2cd1c5d856 service neutron] Pushing event updated for resources: {'Port': ['ID=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:04.801051 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-852435fb-9f93-4d62-b2fe-17459cdc462e x-openstack-request-id: req-852435fb-9f93-4d62-b2fe-17459cdc462e {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:04.801345 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a8ee2ec0-d1d7-458d-ae2a-509098efff13", "tag": "eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:04.801602 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-852435fb-9f93-4d62-b2fe-17459cdc462e {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:04.801996 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'tag': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'status': 'completed', 'code': 200} Dec 09 14:43:04.844516 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-4385a081-9922-4ba4-9e91-4e916008f735 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?name=tempest-securitygroup--598611852&fields=id&tenant_id=a538bf01cb5440ffa06b6873f212efaa HTTP/1.1" status: 200 len: 267 time: 0.0603521 Dec 09 14:43:04.929969 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cbd212e-a5d6-4fde-a325-582cdb50d5fe req-3203c6b8-a9d9-4b79-a60e-09f666e79beb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:04.931558 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8cbd212e-a5d6-4fde-a325-582cdb50d5fe req-3203c6b8-a9d9-4b79-a60e-09f666e79beb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0485251 Dec 09 14:43:04.957966 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-32523d67-9a36-4608-97dc-fa73215c9b9e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:04.959497 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-32523d67-9a36-4608-97dc-fa73215c9b9e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/networks?id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b HTTP/1.1" status: 200 len: 810 time: 0.1077192 Dec 09 14:43:04.973958 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-36412a2e-ebba-491a-963e-db1ecffebe73 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/quotas/a538bf01cb5440ffa06b6873f212efaa HTTP/1.1" status: 200 len: 375 time: 0.0087733 Dec 09 14:43:04.980584 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8cbd212e-a5d6-4fde-a325-582cdb50d5fe req-dbe36712-c3bc-42df-867a-45bf6ce8626e tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423348 Dec 09 14:43:05.030177 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-6afaf887-36f2-4ccb-b087-236cef22716e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=a538bf01cb5440ffa06b6873f212efaa&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0509021 Dec 09 14:43:05.128054 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-bcd493e7-238a-44c3-b8a2-b1dc2571341a service neutron] 10.222.0.39 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0832729 Dec 09 14:43:05.226436 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-70934dac-c153-4bba-b430-1585a05bbabb service neutron] 10.222.0.39 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0917139 Dec 09 14:43:05.346599 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f60fccd-5e53-4a75-a03d-e83bdf625269 req-ba56e029-df7d-4a69-a4b3-ddba211bd1ba tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:05.348309 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7f60fccd-5e53-4a75-a03d-e83bdf625269 req-ba56e029-df7d-4a69-a4b3-ddba211bd1ba tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 945 time: 0.0574827 Dec 09 14:43:05.431422 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7f60fccd-5e53-4a75-a03d-e83bdf625269 req-2f3a7415-6190-4300-b2f6-34a70a742bbf tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700905 Dec 09 14:43:05.496773 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-310db42f-6f66-4d37-838c-338df1925a87 req-c2cf042e-42ab-4e35-aa90-e9297e72d79a tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 210 time: 0.0328264 Dec 09 14:43:05.498161 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c03186-aad7-426e-b688-e5c20de75b8c req-a2d2131d-156e-4203-8a11-648b4539f1f6 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:05.500084 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-48c03186-aad7-426e-b688-e5c20de75b8c req-a2d2131d-156e-4203-8a11-648b4539f1f6 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 944 time: 0.0586607 Dec 09 14:43:05.551818 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-48c03186-aad7-426e-b688-e5c20de75b8c req-ba3232ec-df02-4d58-9abe-916ab6d7dc57 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453765 Dec 09 14:43:05.805715 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-755007b0-40d0-4708-b4c8-489210a3bcb8 req-cd8ece6a-9ae9-41be-8966-8232b868d2e4 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 210 time: 0.0280066 Dec 09 14:43:06.113597 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1293858f-cdb7-46ce-9ed9-6e9dda0771a7 req-4ce36410-7b4a-4944-aee6-b56d0f200670 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:06.115103 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1293858f-cdb7-46ce-9ed9-6e9dda0771a7 req-4ce36410-7b4a-4944-aee6-b56d0f200670 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0568323 Dec 09 14:43:06.164200 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1293858f-cdb7-46ce-9ed9-6e9dda0771a7 req-e1b5aadf-b379-455f-a425-fcdc79669991 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425003 Dec 09 14:43:06.478852 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['64e629a5-6b0c-4cc9-87b6-9a69a3792836'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:43:06.480365 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-342cee1c-c27c-435b-89d1-7a34c74b7d0e req-88f01f4c-39d2-4a91-a605-89c785378fc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:06.482200 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-342cee1c-c27c-435b-89d1-7a34c74b7d0e req-88f01f4c-39d2-4a91-a605-89c785378fc6 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=3d298e3ebec54c2281ddf8bbb50b7cea&device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 1096 time: 0.0775692 Dec 09 14:43:06.513626 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0736eb7a-989b-42b3-8c2a-77e1152d5925 req-1ae81519-f465-42a4-a3d4-273eac66431e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:06.515227 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0736eb7a-989b-42b3-8c2a-77e1152d5925 req-1ae81519-f465-42a4-a3d4-273eac66431e service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=6be5d78d2d0049448c3947b4e650758a&device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 1097 time: 0.1183848 Dec 09 14:43:06.589541 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['746ea6aa-be43-4fbf-9463-02d741db305a'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:43:06.690619 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6ac80813-dfd6-49d7-a86e-a0e62d425c27 req-dcff2c2b-6e77-4736-8373-9cfd54f74f3b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 210 time: 0.0503376 Dec 09 14:43:06.697704 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bf9b9bd-b675-45b2-a238-a1d0a23dcc55 req-56fd50a0-5937-4dab-8ccc-620198969558 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:06.713140 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0bf9b9bd-b675-45b2-a238-a1d0a23dcc55 req-56fd50a0-5937-4dab-8ccc-620198969558 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 945 time: 0.1849940 Dec 09 14:43:06.748163 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0736eb7a-989b-42b3-8c2a-77e1152d5925 req-5e4ee1aa-968a-46b2-81fc-f51c64620d6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:06.750538 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0736eb7a-989b-42b3-8c2a-77e1152d5925 req-5e4ee1aa-968a-46b2-81fc-f51c64620d6f service neutron] 10.222.0.44 "GET /v2.0/networks?tenant_id=6be5d78d2d0049448c3947b4e650758a&shared=False HTTP/1.1" status: 200 len: 917 time: 0.2179480 Dec 09 14:43:06.862699 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0bf9b9bd-b675-45b2-a238-a1d0a23dcc55 req-92c3970a-d239-41cf-ac86-0e3135375459 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1434178 Dec 09 14:43:06.885865 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-342cee1c-c27c-435b-89d1-7a34c74b7d0e req-f80ef76f-ea3b-450f-b5a4-88f9124b7199 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:06.889322 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-342cee1c-c27c-435b-89d1-7a34c74b7d0e req-f80ef76f-ea3b-450f-b5a4-88f9124b7199 service neutron] 10.222.0.44 "GET /v2.0/networks?tenant_id=3d298e3ebec54c2281ddf8bbb50b7cea&shared=False HTTP/1.1" status: 200 len: 919 time: 0.3914640 Dec 09 14:43:06.930520 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0736eb7a-989b-42b3-8c2a-77e1152d5925 req-807a8077-f73b-42d2-80c8-0d82f15557dc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:06.933752 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0736eb7a-989b-42b3-8c2a-77e1152d5925 req-807a8077-f73b-42d2-80c8-0d82f15557dc service neutron] 10.222.0.44 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1750832 Dec 09 14:43:07.071220 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0221e761-e900-420c-93e0-492eac050ac1 req-e2d01667-e23f-4c4b-99aa-6d510ec0561b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 210 time: 0.0451195 Dec 09 14:43:07.139641 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52372) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:07.163045 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-342cee1c-c27c-435b-89d1-7a34c74b7d0e req-3b90fdc4-1a0e-4476-bc77-b087bdfe000b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:07.164659 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-342cee1c-c27c-435b-89d1-7a34c74b7d0e req-3b90fdc4-1a0e-4476-bc77-b087bdfe000b service neutron] 10.222.0.44 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2692027 Dec 09 14:43:07.219003 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e2c6f26-aa96-4c5a-8883-b4f5b9fb963c req-e1b6a612-8b8a-4ee7-82b4-2bbdb16133f9 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:07.220757 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3e2c6f26-aa96-4c5a-8883-b4f5b9fb963c req-e1b6a612-8b8a-4ee7-82b4-2bbdb16133f9 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 944 time: 0.2662640 Dec 09 14:43:07.238205 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-cb542955-8d92-4304-9851-338c8216d38e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:07.239685 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-cb542955-8d92-4304-9851-338c8216d38e service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=6be5d78d2d0049448c3947b4e650758a&device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 1097 time: 0.1911557 Dec 09 14:43:07.281806 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-1f747819-f8d7-4d93-a4d4-7124025cbc68 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:07.283437 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-1f747819-f8d7-4d93-a4d4-7124025cbc68 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.44 "GET /v2.0/networks?id=8ff38a1e-5122-4806-8b7d-d4c281cbe550 HTTP/1.1" status: 200 len: 818 time: 0.3484993 Dec 09 14:43:07.320498 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-dcf108dd-446d-4a9b-aae5-ed86d5940e9e admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:07.322108 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-64a24033-8dbf-4428-8743-ad228333d6ab tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Request body: {'port': {'device_id': 'a496d15e-076c-47a9-9cc3-a0e61bed5ae0', 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550', 'admin_state_up': True, 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:07.328635 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-19c92521-0b56-4801-bc14-4ab3ad64b5cf service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 HTTP/1.1" status: 200 len: 217 time: 0.0683911 Dec 09 14:43:07.341479 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-1b5bdd08-3b8f-4369-a6ee-94d757aa2e59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:07.343004 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-1b5bdd08-3b8f-4369-a6ee-94d757aa2e59 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=3d298e3ebec54c2281ddf8bbb50b7cea&device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 1096 time: 0.1020875 Dec 09 14:43:07.373783 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3643e16c-ba83-4e62-9d2a-f92947608f34 req-b5448b68-b2a5-427b-9a00-a42bc2e5b2b0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:07.381133 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3643e16c-ba83-4e62-9d2a-f92947608f34 req-b5448b68-b2a5-427b-9a00-a42bc2e5b2b0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.1111834 Dec 09 14:43:07.413051 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.44', 63470) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:07.430752 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-3963b0ff-1c52-4a1c-b6b1-194042ebe611 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=bb290a6d-709a-49d1-bd2e-10c0fe664657 HTTP/1.1" status: 200 len: 217 time: 0.0758946 Dec 09 14:43:07.447774 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3e2c6f26-aa96-4c5a-8883-b4f5b9fb963c req-ec97ae36-f525-43ed-a288-b52fa8a60655 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2173617 Dec 09 14:43:07.536276 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3643e16c-ba83-4e62-9d2a-f92947608f34 req-ef76e40b-a567-4c00-88a4-dcf9a02a86d4 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1541364 Dec 09 14:43:07.562627 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-4409f027-930d-4a46-8f6c-9a84758c18a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:07.564444 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-4409f027-930d-4a46-8f6c-9a84758c18a9 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=90388423-2d07-4cbe-80d8-fa2f6a3c14f7 HTTP/1.1" status: 200 len: 858 time: 0.1229937 Dec 09 14:43:07.609700 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-16628d79-7a00-4e24-9a34-20e33cec17da service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=8ff38a1e-5122-4806-8b7d-d4c281cbe550&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0364599 Dec 09 14:43:07.634187 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-dcf108dd-446d-4a9b-aae5-ed86d5940e9e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:07.682183 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52392) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:07.684149 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-dcf108dd-446d-4a9b-aae5-ed86d5940e9e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:07.729306 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-24fc6dba-ece0-4b51-b841-8bfe5f377be7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:07.730755 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-24fc6dba-ece0-4b51-b841-8bfe5f377be7 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=f10f1097-5d43-4737-bcac-a27ade66b442 HTTP/1.1" status: 200 len: 855 time: 0.3841283 Dec 09 14:43:07.760734 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-dcf108dd-446d-4a9b-aae5-ed86d5940e9e admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=c71129baaa794ba4ba0193d611497743&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6199465 Dec 09 14:43:07.766277 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52400) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:07.813279 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcf108dd-446d-4a9b-aae5-ed86d5940e9e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=13f2156c-d2b5-48ba-93dd-d381910fb5c4,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:07.871781 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8a5cc08b-7dec-406f-ac5c-9777ea83e4da admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:07.874987 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-683b191b-5596-43b0-9e04-19ea13075cdb service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2561824 Dec 09 14:43:07.889045 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-144d1f02-2330-4af8-bf1a-3d884cc3be67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:07.890934 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-144d1f02-2330-4af8-bf1a-3d884cc3be67 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=9ab3f8b6-44d0-4210-907d-0e96072c4566&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1510687 Dec 09 14:43:07.913263 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fb00ba94-2dae-4302-967c-02c220732f00 req-6d1aa398-9b97-4c27-b944-dd9a1480b18d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 210 time: 0.0752897 Dec 09 14:43:07.970586 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-64a24033-8dbf-4428-8743-ad228333d6ab tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Made reservation on behalf of 3d298e3ebec54c2281ddf8bbb50b7cea for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:43:07.974188 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5aff86a1-f510-4ed6-88f8-ca67a5d4a6fb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:07.974350 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-64a24033-8dbf-4428-8743-ad228333d6ab tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:07.985009 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-7aec04a6-0fd4-48d1-b68a-0adaebbbfac1 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:07.986464 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-7aec04a6-0fd4-48d1-b68a-0adaebbbfac1 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.44 "GET /v2.0/networks?id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b HTTP/1.1" status: 200 len: 810 time: 0.5690429 Dec 09 14:43:08.040965 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5aff86a1-f510-4ed6-88f8-ca67a5d4a6fb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:08.125447 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-1e3984a8-a8f6-48cc-a36d-9ff3102eda3d service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2166455 Dec 09 14:43:08.127905 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bf53617-833b-42e5-bfff-af8fb973857f req-d87edc51-9ab0-4694-a232-e2d57a2ed8f7 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:08.129399 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2bf53617-833b-42e5-bfff-af8fb973857f req-d87edc51-9ab0-4694-a232-e2d57a2ed8f7 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 945 time: 0.1562877 Dec 09 14:43:08.160692 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-b7b3f086-fc18-49e4-9632-accf1aeabaad service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2742193 Dec 09 14:43:08.169760 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 746ea6aa-be43-4fbf-9463-02d741db305a up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:43:08.190893 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-883c1170-38bf-4987-9b7d-e0733bb36e2b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.44 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a538bf01cb5440ffa06b6873f212efaa HTTP/1.1" status: 200 len: 379 time: 0.1915717 Dec 09 14:43:08.213252 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8a5cc08b-7dec-406f-ac5c-9777ea83e4da admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:08.227337 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8a5cc08b-7dec-406f-ac5c-9777ea83e4da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:08.230294 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-d4a86534-ce05-4c7c-88f7-01ced68029dc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Request body: {'port': {'device_id': '31f6f258-99da-4d63-b6dd-0b20015bf98e', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'admin_state_up': True, 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'security_groups': ['9a3248f4-1741-4d7a-a680-075df7d725b8']}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:08.252035 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port 746ea6aa-be43-4fbf-9463-02d741db305a completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:43:08.253980 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port 746ea6aa-be43-4fbf-9463-02d741db305a triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:08.254353 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:08.276022 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-8a5cc08b-7dec-406f-ac5c-9777ea83e4da admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=b9453185e075417b883aca52cdc2982d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5926259 Dec 09 14:43:08.276659 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5aff86a1-f510-4ed6-88f8-ca67a5d4a6fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:08.279742 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5aff86a1-f510-4ed6-88f8-ca67a5d4a6fb admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:08.280921 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-5aff86a1-f510-4ed6-88f8-ca67a5d4a6fb admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/13f2156c-d2b5-48ba-93dd-d381910fb5c4 HTTP/1.1" status: 204 len: 168 time: 0.5024610 Dec 09 14:43:08.281385 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52418) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:08.309717 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a5cc08b-7dec-406f-ac5c-9777ea83e4da admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c8a86a8c-4ddf-4c36-bb89-8157d444e05c,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:08.334761 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5aff86a1-f510-4ed6-88f8-ca67a5d4a6fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=13f2156c-d2b5-48ba-93dd-d381910fb5c4,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:08.349891 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ffdd2482-cd76-4d10-bc44-f802acb8a608 req-65ad6191-1dfc-46ba-badf-0a0284de87b2 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 210 time: 0.1843848 Dec 09 14:43:08.355546 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2bf53617-833b-42e5-bfff-af8fb973857f req-d3dfe19f-f2f8-40a1-8564-4f7dce63fb0c tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2122314 Dec 09 14:43:08.397879 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:08.423198 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c97d018e-9866-4c56-8334-267a2c2c4465', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '746ea6aa-be43-4fbf-9463-02d741db305a'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:08.424518 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3179faf7-e43d-4d64-8b3d-2d5556f06271 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:08.458295 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3179faf7-e43d-4d64-8b3d-2d5556f06271 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:08.501831 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 746ea6aa-be43-4fbf-9463-02d741db305a, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=746ea6aa-be43-4fbf-9463-02d741db305a,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:08.507629 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:08.508677 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 64e629a5-6b0c-4cc9-87b6-9a69a3792836 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:43:08.522801 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3179faf7-e43d-4d64-8b3d-2d5556f06271 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:08.523384 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7fc8cea1-36d5-42c3-b8ac-8d1037471693 req-02226f2f-4568-4920-83fd-6b50559a5c3f service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3861957 Dec 09 14:43:08.527785 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-64a24033-8dbf-4428-8743-ad228333d6ab tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Allocated IP 172.20.0.2 (8ff38a1e-5122-4806-8b7d-d4c281cbe550/90388423-2d07-4cbe-80d8-fa2f6a3c14f7/2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:43:08.531647 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3179faf7-e43d-4d64-8b3d-2d5556f06271 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:08.535262 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-3179faf7-e43d-4d64-8b3d-2d5556f06271 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/c8a86a8c-4ddf-4c36-bb89-8157d444e05c HTTP/1.1" status: 204 len: 168 time: 0.2269895 Dec 09 14:43:08.558235 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-d4a86534-ce05-4c7c-88f7-01ced68029dc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Made reservation on behalf of a538bf01cb5440ffa06b6873f212efaa for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:43:08.559573 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3179faf7-e43d-4d64-8b3d-2d5556f06271 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c8a86a8c-4ddf-4c36-bb89-8157d444e05c,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:08.562655 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-d4a86534-ce05-4c7c-88f7-01ced68029dc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:08.644148 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=746ea6aa-be43-4fbf-9463-02d741db305a,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:08.661298 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port 64e629a5-6b0c-4cc9-87b6-9a69a3792836 completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:43:08.668436 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port 64e629a5-6b0c-4cc9-87b6-9a69a3792836 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:08.669255 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:08.711321 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5d4ab494-f453-4cbc-8753-ae2aaeca8760" -d '{"events": [{"server_uuid": "c97d018e-9866-4c56-8334-267a2c2c4465", "name": "network-vif-plugged", "status": "completed", "tag": "746ea6aa-be43-4fbf-9463-02d741db305a"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:08.758573 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-230ea890-893a-4068-9405-d26e79fbe166 req-7b08db33-3ea7-47bf-b1e6-2366b2b878fc tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:08.767596 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-230ea890-893a-4068-9405-d26e79fbe166 req-7b08db33-3ea7-47bf-b1e6-2366b2b878fc tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.1001222 Dec 09 14:43:08.776022 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90b01fb3-52d7-490e-a92c-1ed0db9c3592 req-c9c456d9-f982-4a99-9b0e-bee6d1686624 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:08.777639 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-90b01fb3-52d7-490e-a92c-1ed0db9c3592 req-c9c456d9-f982-4a99-9b0e-bee6d1686624 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 945 time: 0.1830838 Dec 09 14:43:08.846920 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-230ea890-893a-4068-9405-d26e79fbe166 req-bc0786e0-763f-4db2-9e3d-5cd718f776f6 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0783148 Dec 09 14:43:08.933427 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-90b01fb3-52d7-490e-a92c-1ed0db9c3592 req-9ad2a236-2646-4efd-ac27-2cd236846d02 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1462929 Dec 09 14:43:08.987775 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:08.990758 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-d4a86534-ce05-4c7c-88f7-01ced68029dc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Allocated IP 172.20.0.9 (1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b/4b7e026c-4454-4200-91c3-30d27a976452/c5d8b8cc-2c67-46a7-867d-276136fccdf1) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:43:09.006822 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-64a24033-8dbf-4428-8743-ad228333d6ab tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.029515 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 64e629a5-6b0c-4cc9-87b6-9a69a3792836, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=64e629a5-6b0c-4cc9-87b6-9a69a3792836,segment=NetworkSegment(2cc4f8a7-4cb6-4253-83d3-39c4929772e8),segment_id=2cc4f8a7-4cb6-4253-83d3-39c4929772e8)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:09.035143 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.057899 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9de89c6d-4727-4c71-be28-320ec8b5ee2f req-6cd1908c-e51b-4dc0-89cf-c4d92abdf282 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 210 time: 0.0584419 Dec 09 14:43:09.095770 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=64e629a5-6b0c-4cc9-87b6-9a69a3792836,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:09.116445 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5e463e90-3e99-4b72-b4a9-af0d60f5e28d x-openstack-request-id: req-5e463e90-3e99-4b72-b4a9-af0d60f5e28d {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:09.117652 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c97d018e-9866-4c56-8334-267a2c2c4465", "name": "network-vif-plugged", "status": "completed", "tag": "746ea6aa-be43-4fbf-9463-02d741db305a", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:09.118593 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-5e463e90-3e99-4b72-b4a9-af0d60f5e28d {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:09.119806 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c97d018e-9866-4c56-8334-267a2c2c4465', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '746ea6aa-be43-4fbf-9463-02d741db305a', 'code': 200} Dec 09 14:43:09.164680 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52452) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:09.183902 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-64a24033-8dbf-4428-8743-ad228333d6ab tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.187631 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-859940c1-6d03-4d11-aacb-59bc3253d88c admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.235440 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-64a24033-8dbf-4428-8743-ad228333d6ab tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:43:09.243104 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-64a24033-8dbf-4428-8743-ad228333d6ab tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:43:09.254606 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-64a24033-8dbf-4428-8743-ad228333d6ab tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:43:09.282630 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-859940c1-6d03-4d11-aacb-59bc3253d88c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.287658 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-859940c1-6d03-4d11-aacb-59bc3253d88c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.328052 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-859940c1-6d03-4d11-aacb-59bc3253d88c admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=b4c7c9ae1bc84f5ea56072252ad292e3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1593924 Dec 09 14:43:09.328052 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-859940c1-6d03-4d11-aacb-59bc3253d88c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5ed87a8e-6cd9-47c6-b8da-65042d81b092,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:09.328862 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52454) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:09.365928 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a24033-8dbf-4428-8743-ad228333d6ab tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Pushing event updated for resources: {'Port': ['ID=2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:09.403535 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0d544ec8-818b-418f-82c8-aa1bb710ae3b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.410846 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-d4a86534-ce05-4c7c-88f7-01ced68029dc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.414145 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82100240-707f-4277-8ad3-9dc2e54f0fb7 req-a314206a-0dce-4eb3-9460-c0e5a8d8f677 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:09.415932 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82100240-707f-4277-8ad3-9dc2e54f0fb7 req-a314206a-0dce-4eb3-9460-c0e5a8d8f677 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 1098 time: 0.1292055 Dec 09 14:43:09.425136 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-64a24033-8dbf-4428-8743-ad228333d6ab tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:09.427128 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-64a24033-8dbf-4428-8743-ad228333d6ab tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.471737 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-82100240-707f-4277-8ad3-9dc2e54f0fb7 req-fd8838cf-52a6-4f5a-8c1f-3f547bd91de6 service neutron] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.472087 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0d544ec8-818b-418f-82c8-aa1bb710ae3b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.502294 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-64a24033-8dbf-4428-8743-ad228333d6ab tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.1847029 Dec 09 14:43:09.527941 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Request body: {'port': {'device_id': 'a496d15e-076c-47a9-9cc3-a0e61bed5ae0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:09.607834 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0d544ec8-818b-418f-82c8-aa1bb710ae3b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.611069 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0d544ec8-818b-418f-82c8-aa1bb710ae3b admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.612462 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-0d544ec8-818b-418f-82c8-aa1bb710ae3b admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/5ed87a8e-6cd9-47c6-b8da-65042d81b092 HTTP/1.1" status: 204 len: 168 time: 0.2830431 Dec 09 14:43:09.623579 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d544ec8-818b-418f-82c8-aa1bb710ae3b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ed87a8e-6cd9-47c6-b8da-65042d81b092,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:09.632480 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-d4a86534-ce05-4c7c-88f7-01ced68029dc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.637778 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-288fa31a-3efd-4ac4-999b-4c743a90eef8 req-2930a193-c993-4074-8783-e549b368124e tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:09.645150 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-288fa31a-3efd-4ac4-999b-4c743a90eef8 req-2930a193-c993-4074-8783-e549b368124e tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 946 time: 0.1114328 Dec 09 14:43:09.663763 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec2b2fc9-07b0-4df6-8791-41dff686378f req-36210b4f-e9c2-4c51-8136-c18aa78a9bb7 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:09.670873 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ec2b2fc9-07b0-4df6-8791-41dff686378f req-36210b4f-e9c2-4c51-8136-c18aa78a9bb7 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 931 time: 0.1675544 Dec 09 14:43:09.709496 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.714599 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-288fa31a-3efd-4ac4-999b-4c743a90eef8 req-4e68bb10-5edd-4019-839a-152b2592fea4 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0684841 Dec 09 14:43:09.753337 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-82100240-707f-4277-8ad3-9dc2e54f0fb7 req-fd8838cf-52a6-4f5a-8c1f-3f547bd91de6 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.786434 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-82100240-707f-4277-8ad3-9dc2e54f0fb7 req-fd8838cf-52a6-4f5a-8c1f-3f547bd91de6 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:09.802895 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-d4a86534-ce05-4c7c-88f7-01ced68029dc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:43:09.808237 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4a86534-ce05-4c7c-88f7-01ced68029dc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event updated for resources: {'Port': ['ID=c5d8b8cc-2c67-46a7-867d-276136fccdf1,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:09.829861 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-d4a86534-ce05-4c7c-88f7-01ced68029dc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:43:09.832549 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-d4a86534-ce05-4c7c-88f7-01ced68029dc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:43:09.942654 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82100240-707f-4277-8ad3-9dc2e54f0fb7 req-fd8838cf-52a6-4f5a-8c1f-3f547bd91de6 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5104105 Dec 09 14:43:09.949655 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd8838cf-52a6-4f5a-8c1f-3f547bd91de6 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=cf56e7e2-6dec-44e9-b958-a1a374ffd2b7,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:10.016491 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ec2b2fc9-07b0-4df6-8791-41dff686378f req-0acd332e-3f91-4b84-8a5e-05c1821cecaa tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3447046 Dec 09 14:43:10.034840 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05629e8b-b079-4667-9f18-5c837de477fa req-fa3f76bd-987b-41e5-b33f-6e5f83b956da tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:10.043483 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-05629e8b-b079-4667-9f18-5c837de477fa req-fa3f76bd-987b-41e5-b33f-6e5f83b956da tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0802386 Dec 09 14:43:10.082092 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-d4a86534-ce05-4c7c-88f7-01ced68029dc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:10.082764 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-d4a86534-ce05-4c7c-88f7-01ced68029dc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:10.108728 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-05629e8b-b079-4667-9f18-5c837de477fa req-66defda0-59c6-4d57-86fc-111a66312dc5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0641541 Dec 09 14:43:10.122131 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-d4a86534-ce05-4c7c-88f7-01ced68029dc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.8958001 Dec 09 14:43:10.171903 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device bb290a6d-709a-49d1-bd2e-10c0fe664657 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:43:10.225919 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Request body: {'port': {'device_id': '31f6f258-99da-4d63-b6dd-0b20015bf98e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:10.235341 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29247d07-e602-4c4a-baa0-8907d50f20fb req-bac0b5b1-f7f7-4a18-869f-5df0df254e97 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:10.247069 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-29247d07-e602-4c4a-baa0-8907d50f20fb req-bac0b5b1-f7f7-4a18-869f-5df0df254e97 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 931 time: 0.0772810 Dec 09 14:43:10.332811 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-29247d07-e602-4c4a-baa0-8907d50f20fb req-5c18ded7-da9f-4556-88af-f71d60ef5bb2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0842638 Dec 09 14:43:10.338802 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port bb290a6d-709a-49d1-bd2e-10c0fe664657, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=bb290a6d-709a-49d1-bd2e-10c0fe664657,segment=NetworkSegment(7ece4ded-a169-4d54-b911-54a5a65cd0ce),segment_id=7ece4ded-a169-4d54-b911-54a5a65cd0ce)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:10.356535 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': 'bb290a6d-709a-49d1-bd2e-10c0fe664657', 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550', 'port_id': 'bb290a6d-709a-49d1-bd2e-10c0fe664657', 'mac_address': 'fa:16:3e:f3:90:f5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 425, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '90388423-2d07-4cbe-80d8-fa2f6a3c14f7', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:43:10.382171 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-397a68b3-b783-4336-b2fc-54ae2b57ef8f req-c3b1e016-ab0b-485f-a4f4-ccdf2e909518 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:10.384365 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-397a68b3-b783-4336-b2fc-54ae2b57ef8f req-c3b1e016-ab0b-485f-a4f4-ccdf2e909518 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 945 time: 0.2248876 Dec 09 14:43:10.390385 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:10.407877 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:10.425117 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bb290a6d-709a-49d1-bd2e-10c0fe664657 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:43:10.431849 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-78e5b3c4-85ef-4b48-88e3-535f981c5aac None None] Provisioning complete for port c5d8b8cc-2c67-46a7-867d-276136fccdf1 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:10.432429 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-78e5b3c4-85ef-4b48-88e3-535f981c5aac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:10.474760 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-78e5b3c4-85ef-4b48-88e3-535f981c5aac None None] Port c5d8b8cc-2c67-46a7-867d-276136fccdf1 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:43:10.491807 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port bb290a6d-709a-49d1-bd2e-10c0fe664657, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=bb290a6d-709a-49d1-bd2e-10c0fe664657,segment=NetworkSegment(7ece4ded-a169-4d54-b911-54a5a65cd0ce),segment_id=7ece4ded-a169-4d54-b911-54a5a65cd0ce)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:10.498342 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:10.499327 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:43:10.620379 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=bb290a6d-709a-49d1-bd2e-10c0fe664657,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:10.668511 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:10.675705 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-397a68b3-b783-4336-b2fc-54ae2b57ef8f req-097db4cc-e008-4096-8bce-c1413188bb9a tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2662871 Dec 09 14:43:10.686102 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'port_id': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'mac_address': 'fa:16:3e:50:6b:8c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 412, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:43:10.782012 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:10.812514 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:43:10.847010 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:10.854028 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:10.865778 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8aee769-5d03-489f-aadf-8796a5697d69 req-56561159-a1a3-4558-b368-43a2329af1fd tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:10.870880 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:43:10.877140 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b8aee769-5d03-489f-aadf-8796a5697d69 req-56561159-a1a3-4558-b368-43a2329af1fd tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 946 time: 0.0744529 Dec 09 14:43:10.883441 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:10.913045 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Transition to ACTIVE for port object 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:43:10.921703 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:10.938878 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:10.959596 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b8aee769-5d03-489f-aadf-8796a5697d69 req-ec310c53-0032-4e3e-88b5-2fcb4b21cf82 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811107 Dec 09 14:43:10.998181 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Pushing event updated for resources: {'Port': ['ID=2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:11.108407 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c5d8b8cc-2c67-46a7-867d-276136fccdf1 {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:43:11.119375 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:11.120659 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['bb290a6d-709a-49d1-bd2e-10c0fe664657'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:43:11.123732 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '201d80a0-533f-4dd7-bd29-b19f9a27b094', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '64e629a5-6b0c-4cc9-87b6-9a69a3792836'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:11.127132 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46b2fd40-6dba-483f-b8f5-95f31ec605da" -d '{"events": [{"server_uuid": "201d80a0-533f-4dd7-bd29-b19f9a27b094", "name": "network-vif-plugged", "status": "completed", "tag": "64e629a5-6b0c-4cc9-87b6-9a69a3792836"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:11.140960 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Attempting to bind port 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:43:11.141298 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Attempting to bind port 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': '7ece4ded-a169-4d54-b911-54a5a65cd0ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:43:11.141634 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Attempting to bind port 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 on network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:43:11.146747 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Transition to ACTIVE for port object c5d8b8cc-2c67-46a7-867d-276136fccdf1 will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:43:11.149082 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Port 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 on network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:43:11.149351 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Attempting to bind port 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 on network 8ff38a1e-5122-4806-8b7d-d4c281cbe550 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:43:11.154485 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:11.166618 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 42, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:43:11.166956 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Checking segment: {'id': '7ece4ded-a169-4d54-b911-54a5a65cd0ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:43:11.167334 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Bound using segment: {'id': '7ece4ded-a169-4d54-b911-54a5a65cd0ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:43:11.167822 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Bound port: 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7ece4ded-a169-4d54-b911-54a5a65cd0ce', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 425, 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:43:11.168180 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:11.277857 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:43:11.358265 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] For port 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:43:11.365459 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] For port 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6,segment=NetworkSegment(7ece4ded-a169-4d54-b911-54a5a65cd0ce),segment_id=7ece4ded-a169-4d54-b911-54a5a65cd0ce)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:43:11.370250 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07830226-3970-4025-97ed-5a42bff51d78 req-965de312-35f5-4515-a958-01923be7f5bb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:11.392376 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-07830226-3970-4025-97ed-5a42bff51d78 req-965de312-35f5-4515-a958-01923be7f5bb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 945 time: 0.1328876 Dec 09 14:43:11.406254 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:11.410999 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Pushing event updated for resources: {'Port': ['ID=c5d8b8cc-2c67-46a7-867d-276136fccdf1,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:11.499806 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-07830226-3970-4025-97ed-5a42bff51d78 req-55a6543d-3f83-4908-b207-30d2cef85bfe tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0783744 Dec 09 14:43:11.517681 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Pushing event updated for resources: {'Port': ['ID=2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:11.535911 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:11.535911 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:11.537297 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-034e782a-9e8d-4c25-99e0-5ae836d60884 service neutron] 10.222.0.44 "PUT /v2.0/ports/2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 HTTP/1.1" status: 200 len: 1093 time: 2.0266774 Dec 09 14:43:11.537829 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a496d15e-076c-47a9-9cc3-a0e61bed5ae0', 'tag': '2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:11.540250 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cfe37433-cdf7-4cae-bc3a-1a17dda5dcac" -d '{"events": [{"name": "network-changed", "server_uuid": "a496d15e-076c-47a9-9cc3-a0e61bed5ae0", "tag": "2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:11.590714 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c36a0e94-d280-4d88-92cb-1a5c57f1af3c req-0a02a8e5-2e31-4812-84df-2f457de43b9d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:11.600333 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c36a0e94-d280-4d88-92cb-1a5c57f1af3c req-0a02a8e5-2e31-4812-84df-2f457de43b9d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 943 time: 0.4018948 Dec 09 14:43:11.647634 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c04ac68d-e8c1-47fa-b00d-a639431a97a6 x-openstack-request-id: req-c04ac68d-e8c1-47fa-b00d-a639431a97a6 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:11.648074 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "201d80a0-533f-4dd7-bd29-b19f9a27b094", "name": "network-vif-plugged", "status": "completed", "tag": "64e629a5-6b0c-4cc9-87b6-9a69a3792836", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:11.648427 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-c04ac68d-e8c1-47fa-b00d-a639431a97a6 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:11.648884 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '201d80a0-533f-4dd7-bd29-b19f9a27b094', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '64e629a5-6b0c-4cc9-87b6-9a69a3792836', 'code': 200} Dec 09 14:43:11.688802 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Attempting to bind port c5d8b8cc-2c67-46a7-867d-276136fccdf1 on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:43:11.690018 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Attempting to bind port c5d8b8cc-2c67-46a7-867d-276136fccdf1 by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:43:11.690455 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Attempting to bind port c5d8b8cc-2c67-46a7-867d-276136fccdf1 on network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:43:11.727179 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Port c5d8b8cc-2c67-46a7-867d-276136fccdf1 on network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:43:11.727633 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Attempting to bind port c5d8b8cc-2c67-46a7-867d-276136fccdf1 on network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:43:11.735777 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 42, 44), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:43:11.736335 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Checking segment: {'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:43:11.736832 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Bound using segment: {'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:43:11.737372 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Bound port: c5d8b8cc-2c67-46a7-867d-276136fccdf1, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:43:11.737849 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:11.775373 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-5c15640f-f8cf-4f96-8e6a-b1d5b7c39d9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:11.777045 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-5c15640f-f8cf-4f96-8e6a-b1d5b7c39d9a service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=3d298e3ebec54c2281ddf8bbb50b7cea&device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 1096 time: 0.1710784 Dec 09 14:43:11.879973 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c406fe91-7d29-4150-a173-2cae841526c3 req-4a86f028-2b42-418e-a4fe-1f8d804e0a91 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:11.888321 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c406fe91-7d29-4150-a173-2cae841526c3 req-4a86f028-2b42-418e-a4fe-1f8d804e0a91 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 943 time: 0.1146505 Dec 09 14:43:11.889993 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52612) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:11.920883 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] For port c5d8b8cc-2c67-46a7-867d-276136fccdf1, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:43:11.927485 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] For port c5d8b8cc-2c67-46a7-867d-276136fccdf1, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=c5d8b8cc-2c67-46a7-867d-276136fccdf1,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:43:11.957221 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:11.987405 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c406fe91-7d29-4150-a173-2cae841526c3 req-0f49ab02-15dc-493a-af9b-12cc18ef47a7 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0981629 Dec 09 14:43:12.063020 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-956ee8b8-0527-4c21-aba5-2894d208dce5 x-openstack-request-id: req-956ee8b8-0527-4c21-aba5-2894d208dce5 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:12.063510 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a496d15e-076c-47a9-9cc3-a0e61bed5ae0", "tag": "2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:12.063804 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-956ee8b8-0527-4c21-aba5-2894d208dce5 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:12.064197 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a496d15e-076c-47a9-9cc3-a0e61bed5ae0', 'tag': '2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6', 'status': 'completed', 'code': 200} Dec 09 14:43:12.077019 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-dbcb00d3-ee60-4c2f-b395-a3c9ee900daf service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 HTTP/1.1" status: 200 len: 217 time: 0.1480131 Dec 09 14:43:12.086161 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c36a0e94-d280-4d88-92cb-1a5c57f1af3c req-07d67393-8231-4162-bc15-a3f5ddb7e860 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4818432 Dec 09 14:43:12.113299 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:12.114105 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:12.115834 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] 10.222.0.44 "PUT /v2.0/ports/c5d8b8cc-2c67-46a7-867d-276136fccdf1 HTTP/1.1" status: 200 len: 1093 time: 1.9529145 Dec 09 14:43:12.125183 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3e2f9d1-d5bb-43c8-b756-fa2f4ee34804 service neutron] Pushing event updated for resources: {'Port': ['ID=c5d8b8cc-2c67-46a7-867d-276136fccdf1,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:12.226004 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d0c9ec9b-15d5-4160-bbe0-c905b78f4211 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:12.241482 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1deebd0f-7c4d-4776-abd7-280d2e703830 req-8d9f82a0-8267-466d-b00d-a6f0ffc26f6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:12.244689 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1deebd0f-7c4d-4776-abd7-280d2e703830 req-8d9f82a0-8267-466d-b00d-a6f0ffc26f6d service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 1099 time: 0.1836674 Dec 09 14:43:12.250121 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-46216dd0-0355-49e4-8f42-54f1d1528485 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:12.252026 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-46216dd0-0355-49e4-8f42-54f1d1528485 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=90388423-2d07-4cbe-80d8-fa2f6a3c14f7 HTTP/1.1" status: 200 len: 858 time: 0.1649568 Dec 09 14:43:12.272417 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cb0692e-d8dc-4d67-ae4a-0c45e19ff9f5 req-1f95ac02-2999-4ea9-aeab-f0270aeecdd2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:12.274223 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3cb0692e-d8dc-4d67-ae4a-0c45e19ff9f5 req-1f95ac02-2999-4ea9-aeab-f0270aeecdd2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 945 time: 0.1037662 Dec 09 14:43:12.349029 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-7bf7805c-98e4-495e-9d89-dc1e56bd1c33 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=8ff38a1e-5122-4806-8b7d-d4c281cbe550&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0612173 Dec 09 14:43:12.356424 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3cb0692e-d8dc-4d67-ae4a-0c45e19ff9f5 req-703bfd08-6051-432b-8118-ebc657116652 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0746760 Dec 09 14:43:12.379723 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-116b9b71-dee1-4eca-806c-203d42a12bf0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:12.380558 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-116b9b71-dee1-4eca-806c-203d42a12bf0 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=a538bf01cb5440ffa06b6873f212efaa&device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 1096 time: 0.2024000 Dec 09 14:43:12.381204 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d0c9ec9b-15d5-4160-bbe0-c905b78f4211 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:12.396762 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d0c9ec9b-15d5-4160-bbe0-c905b78f4211 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:12.460289 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1deebd0f-7c4d-4776-abd7-280d2e703830 req-8b8ae962-381b-43cb-9e5f-6c0fde901c0a service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1903508 Dec 09 14:43:12.464969 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-d0c9ec9b-15d5-4160-bbe0-c905b78f4211 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=201c4a65e735403a9a72e91c4dee053f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5732410 Dec 09 14:43:12.467437 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52636) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:12.474647 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0c9ec9b-15d5-4160-bbe0-c905b78f4211 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6bfcdd72-cd04-4b83-9892-4d49c90e0ed6,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:12.501497 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6667cbe9-7c9d-4e60-94e4-d8b1cb639d60 req-67c2a2f3-cfb9-4bf0-a1fb-2e1850506c7e tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:12.508826 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6667cbe9-7c9d-4e60-94e4-d8b1cb639d60 req-67c2a2f3-cfb9-4bf0-a1fb-2e1850506c7e tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 946 time: 0.2555325 Dec 09 14:43:12.513771 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-0c64d82f-5de8-43b2-9316-9abf8603cdb5 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c5d8b8cc-2c67-46a7-867d-276136fccdf1 HTTP/1.1" status: 200 len: 217 time: 0.1217649 Dec 09 14:43:12.556136 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f72b1fc5-1c7d-4ca8-bdd5-99b840a795bd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:12.598874 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f72b1fc5-1c7d-4ca8-bdd5-99b840a795bd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:12.609427 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6667cbe9-7c9d-4e60-94e4-d8b1cb639d60 req-d1c48261-4ab4-458d-841a-e206e49250e7 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0871041 Dec 09 14:43:12.614638 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-a9b322bd-7e1b-4a9c-bb6c-a4800e561ddc service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2580161 Dec 09 14:43:12.684595 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f72b1fc5-1c7d-4ca8-bdd5-99b840a795bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:12.687320 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f72b1fc5-1c7d-4ca8-bdd5-99b840a795bd admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:12.688485 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-f72b1fc5-1c7d-4ca8-bdd5-99b840a795bd admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/6bfcdd72-cd04-4b83-9892-4d49c90e0ed6 HTTP/1.1" status: 204 len: 168 time: 0.2198493 Dec 09 14:43:12.704166 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f72b1fc5-1c7d-4ca8-bdd5-99b840a795bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6bfcdd72-cd04-4b83-9892-4d49c90e0ed6,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:12.739182 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-44271dbf-6e7f-4c25-98b0-fba1b49a6926 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:12.741270 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-44271dbf-6e7f-4c25-98b0-fba1b49a6926 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=4b7e026c-4454-4200-91c3-30d27a976452 HTTP/1.1" status: 200 len: 849 time: 0.0896554 Dec 09 14:43:12.745971 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0da64cc9-e203-4a8c-b218-80b2484da0c3 req-a9681c78-8033-4d79-aaa9-bdde264dbb02 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:12.754098 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0da64cc9-e203-4a8c-b218-80b2484da0c3 req-a9681c78-8033-4d79-aaa9-bdde264dbb02 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 945 time: 0.0972021 Dec 09 14:43:12.808710 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0da64cc9-e203-4a8c-b218-80b2484da0c3 req-1d227301-ae5d-41c3-93cb-f37de4ce3ab4 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0535777 Dec 09 14:43:12.852099 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-16874e0c-0b0d-4732-bf4d-caa0d4fee09b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:12.853596 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-16874e0c-0b0d-4732-bf4d-caa0d4fee09b service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1004865 Dec 09 14:43:12.890909 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1b5d4ef-3fb1-43b1-9978-541dd023d19d req-bf940999-4b92-4233-ad40-fc019efeedac service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2375405 Dec 09 14:43:13.010286 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-6e48d019-d67a-4338-91aa-e1f987dd7d1e service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1449537 Dec 09 14:43:13.013312 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfe37433-cdf7-4cae-bc3a-1a17dda5dcac req-118333ca-cb81-4109-981c-3b233a3cfb08 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:13.015911 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfe37433-cdf7-4cae-bc3a-1a17dda5dcac req-118333ca-cb81-4109-981c-3b233a3cfb08 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=3d298e3ebec54c2281ddf8bbb50b7cea&device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 1096 time: 0.0714903 Dec 09 14:43:13.143678 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52678) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:13.160184 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-124dac2f-10ed-4eb8-8102-6888be6601c9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:13.258075 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dba9e56-d648-4017-b178-9d33b1569b54 req-23c5c1a3-e20d-4701-a796-445c7b60b3ee tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:13.260010 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7dba9e56-d648-4017-b178-9d33b1569b54 req-23c5c1a3-e20d-4701-a796-445c7b60b3ee tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 943 time: 0.0768211 Dec 09 14:43:13.315529 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1799b5a-d8a0-4e3d-9c21-eb2c70565433 req-9bac7059-d123-4bf1-91cb-1c9bb5e45afc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:13.317239 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c1799b5a-d8a0-4e3d-9c21-eb2c70565433 req-9bac7059-d123-4bf1-91cb-1c9bb5e45afc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 943 time: 0.2217321 Dec 09 14:43:13.361227 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7dba9e56-d648-4017-b178-9d33b1569b54 req-e6d268e2-b23d-4a31-94a6-093353a07fad tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0900445 Dec 09 14:43:13.372694 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-124dac2f-10ed-4eb8-8102-6888be6601c9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:13.381701 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-124dac2f-10ed-4eb8-8102-6888be6601c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:13.385927 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51f77e5a-0514-415e-b8cd-807ea92d63de req-2a479e92-05c1-4ffb-b30e-921fa3902ddb service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3611817 Dec 09 14:43:13.388347 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfe37433-cdf7-4cae-bc3a-1a17dda5dcac req-431da3d8-0cee-4941-b77b-f6858ae98718 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:13.389851 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfe37433-cdf7-4cae-bc3a-1a17dda5dcac req-431da3d8-0cee-4941-b77b-f6858ae98718 service neutron] 10.222.0.44 "GET /v2.0/networks?id=8ff38a1e-5122-4806-8b7d-d4c281cbe550 HTTP/1.1" status: 200 len: 919 time: 0.3538268 Dec 09 14:43:13.435014 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-124dac2f-10ed-4eb8-8102-6888be6601c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ced9cc4d-01ca-42f7-9256-981d217691a7,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:13.459866 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-124dac2f-10ed-4eb8-8102-6888be6601c9 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=7aeb91cd89524031800d39e8184c9d43&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3143902 Dec 09 14:43:13.462674 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52692) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:13.472983 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfe37433-cdf7-4cae-bc3a-1a17dda5dcac req-c7ac6349-6000-452f-a794-e4b55aa6791b service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 HTTP/1.1" status: 200 len: 217 time: 0.0611007 Dec 09 14:43:13.477389 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c1799b5a-d8a0-4e3d-9c21-eb2c70565433 req-57bdf2d0-db48-4b8e-a416-293cf63cfe18 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1475444 Dec 09 14:43:13.513998 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f7549919-53bc-4187-894c-a7ac11f9ef3f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:13.535939 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f7549919-53bc-4187-894c-a7ac11f9ef3f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:13.546958 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfe37433-cdf7-4cae-bc3a-1a17dda5dcac req-8e446c43-37de-4c7a-a305-b6e6fabafbb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:13.548611 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfe37433-cdf7-4cae-bc3a-1a17dda5dcac req-8e446c43-37de-4c7a-a305-b6e6fabafbb8 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=90388423-2d07-4cbe-80d8-fa2f6a3c14f7 HTTP/1.1" status: 200 len: 858 time: 0.0469260 Dec 09 14:43:13.593891 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f7549919-53bc-4187-894c-a7ac11f9ef3f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:13.596622 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f7549919-53bc-4187-894c-a7ac11f9ef3f admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:13.601206 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-f7549919-53bc-4187-894c-a7ac11f9ef3f admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/ced9cc4d-01ca-42f7-9256-981d217691a7 HTTP/1.1" status: 204 len: 168 time: 0.1371381 Dec 09 14:43:13.605384 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfe37433-cdf7-4cae-bc3a-1a17dda5dcac req-fdae8a56-7b2d-4591-9864-3b461966e7af service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=8ff38a1e-5122-4806-8b7d-d4c281cbe550&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0429935 Dec 09 14:43:13.611000 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7549919-53bc-4187-894c-a7ac11f9ef3f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ced9cc4d-01ca-42f7-9256-981d217691a7,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:13.784196 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3935fbf2-1a79-4e7e-a26f-cd70280b8789 req-8cdffaaa-09ad-4844-ac90-41a0932bb9e6 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:13.789871 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3935fbf2-1a79-4e7e-a26f-cd70280b8789 req-8cdffaaa-09ad-4844-ac90-41a0932bb9e6 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 946 time: 0.1017387 Dec 09 14:43:13.857070 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3935fbf2-1a79-4e7e-a26f-cd70280b8789 req-628a057b-cc27-408d-a802-d33c0790d4fd tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595417 Dec 09 14:43:13.983909 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56a8a00d-0fcd-4ec8-980a-80a35e69a634 req-08f9f32f-998e-4a5e-ad4b-2895b71ad3b6 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:13.992158 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-56a8a00d-0fcd-4ec8-980a-80a35e69a634 req-08f9f32f-998e-4a5e-ad4b-2895b71ad3b6 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 945 time: 0.0622561 Dec 09 14:43:14.005969 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfe37433-cdf7-4cae-bc3a-1a17dda5dcac req-1e6d10d0-13d7-4e9b-9719-ce2efc02caba service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3806231 Dec 09 14:43:14.054320 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-56a8a00d-0fcd-4ec8-980a-80a35e69a634 req-9705d39b-7ffb-42c0-b911-a6baefee1a97 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0609789 Dec 09 14:43:14.066971 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '31f6f258-99da-4d63-b6dd-0b20015bf98e', 'tag': 'c5d8b8cc-2c67-46a7-867d-276136fccdf1'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:14.069383 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f08c5df4-b19f-4202-aef2-37ddccbf0cd1" -d '{"events": [{"name": "network-changed", "server_uuid": "31f6f258-99da-4d63-b6dd-0b20015bf98e", "tag": "c5d8b8cc-2c67-46a7-867d-276136fccdf1"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:14.134233 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfe37433-cdf7-4cae-bc3a-1a17dda5dcac req-630a9c29-4932-415c-98f3-1fffc524a3f4 service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1170576 Dec 09 14:43:14.139157 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-01aa7455-a94a-4325-90a5-9fda4247c59b x-openstack-request-id: req-01aa7455-a94a-4325-90a5-9fda4247c59b {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:14.140023 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "31f6f258-99da-4d63-b6dd-0b20015bf98e", "tag": "c5d8b8cc-2c67-46a7-867d-276136fccdf1", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:14.140283 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-01aa7455-a94a-4325-90a5-9fda4247c59b {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:14.140814 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '31f6f258-99da-4d63-b6dd-0b20015bf98e', 'tag': 'c5d8b8cc-2c67-46a7-867d-276136fccdf1', 'status': 'completed', 'code': 200} Dec 09 14:43:14.202822 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device bb290a6d-709a-49d1-bd2e-10c0fe664657 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:43:14.214217 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f08c5df4-b19f-4202-aef2-37ddccbf0cd1 req-3e3ee449-00f0-417a-833e-191396859f76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:14.215792 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f08c5df4-b19f-4202-aef2-37ddccbf0cd1 req-3e3ee449-00f0-417a-833e-191396859f76 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=a538bf01cb5440ffa06b6873f212efaa&device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 1096 time: 0.0468478 Dec 09 14:43:14.272216 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port bb290a6d-709a-49d1-bd2e-10c0fe664657 completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:43:14.281290 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port bb290a6d-709a-49d1-bd2e-10c0fe664657 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:14.282070 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:14.335233 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:14.374036 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f08c5df4-b19f-4202-aef2-37ddccbf0cd1 req-3aaaa279-cb56-4a4a-907a-24857b70f80d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:14.375648 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f08c5df4-b19f-4202-aef2-37ddccbf0cd1 req-3aaaa279-cb56-4a4a-907a-24857b70f80d service neutron] 10.222.0.44 "GET /v2.0/networks?id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b HTTP/1.1" status: 200 len: 911 time: 0.1523607 Dec 09 14:43:14.384134 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:14.409545 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '41c03279-323a-43f0-94a0-92862c30a78a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb290a6d-709a-49d1-bd2e-10c0fe664657'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:14.412379 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8a130a7a-cd68-4ea2-8f32-c34ef1c8f1b2" -d '{"events": [{"server_uuid": "41c03279-323a-43f0-94a0-92862c30a78a", "name": "network-vif-plugged", "status": "completed", "tag": "bb290a6d-709a-49d1-bd2e-10c0fe664657"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:14.454272 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port bb290a6d-709a-49d1-bd2e-10c0fe664657, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=bb290a6d-709a-49d1-bd2e-10c0fe664657,segment=NetworkSegment(7ece4ded-a169-4d54-b911-54a5a65cd0ce),segment_id=7ece4ded-a169-4d54-b911-54a5a65cd0ce)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:14.463829 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:14.464950 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:43:14.485370 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f08c5df4-b19f-4202-aef2-37ddccbf0cd1 req-c4210052-02a5-46fb-b55d-21417d564162 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c5d8b8cc-2c67-46a7-867d-276136fccdf1 HTTP/1.1" status: 200 len: 217 time: 0.1025808 Dec 09 14:43:14.536148 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d4564a9d-b8f9-449a-93ad-8cc5a382f90f x-openstack-request-id: req-d4564a9d-b8f9-449a-93ad-8cc5a382f90f {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:14.536745 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "41c03279-323a-43f0-94a0-92862c30a78a", "name": "network-vif-plugged", "status": "completed", "tag": "bb290a6d-709a-49d1-bd2e-10c0fe664657", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:14.537181 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-d4564a9d-b8f9-449a-93ad-8cc5a382f90f {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:14.537716 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '41c03279-323a-43f0-94a0-92862c30a78a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bb290a6d-709a-49d1-bd2e-10c0fe664657', 'code': 200} Dec 09 14:43:14.593245 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21992cb2-06c0-4887-9dfe-c75e243758e1 req-ff707679-5013-485d-b62f-944c6a15dbe7 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:14.598773 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-21992cb2-06c0-4887-9dfe-c75e243758e1 req-ff707679-5013-485d-b62f-944c6a15dbe7 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 943 time: 0.1510465 Dec 09 14:43:14.632132 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52748) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:14.633388 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=bb290a6d-709a-49d1-bd2e-10c0fe664657,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:14.649726 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:43:14.661336 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:14.662112 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:14.673927 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f08c5df4-b19f-4202-aef2-37ddccbf0cd1 req-d8743c16-2819-40af-a53d-67af8ae3460d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:14.675660 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f08c5df4-b19f-4202-aef2-37ddccbf0cd1 req-d8743c16-2819-40af-a53d-67af8ae3460d service neutron] 10.222.0.44 "GET /v2.0/subnets?id=4b7e026c-4454-4200-91c3-30d27a976452 HTTP/1.1" status: 200 len: 849 time: 0.1760375 Dec 09 14:43:14.701529 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-21992cb2-06c0-4887-9dfe-c75e243758e1 req-b2e5d89f-1b34-48d9-978f-4031ee526a0c tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0969713 Dec 09 14:43:14.783493 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58592371-b593-496a-b386-38e2d83e6b70 req-ebdfdd10-8db9-44fc-9988-a81f5055222b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:14.784487 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:14.785181 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-58592371-b593-496a-b386-38e2d83e6b70 req-ebdfdd10-8db9-44fc-9988-a81f5055222b service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 1098 time: 0.0788255 Dec 09 14:43:14.793868 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35b975c9-4ea7-4143-b809-f8fb668ad02a req-444232a3-82ce-48f6-a582-a99069baa496 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:14.801304 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-35b975c9-4ea7-4143-b809-f8fb668ad02a req-444232a3-82ce-48f6-a582-a99069baa496 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 943 time: 0.1881261 Dec 09 14:43:14.832530 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1234523634-network', 'tenant_id': '21222e8023f9407d8236cc1fedf88c2a'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:14.850886 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:14.856775 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f08c5df4-b19f-4202-aef2-37ddccbf0cd1 req-e79c4692-135d-4e51-a75e-79d2af575e5c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:14.857974 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:14.858305 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f08c5df4-b19f-4202-aef2-37ddccbf0cd1 req-e79c4692-135d-4e51-a75e-79d2af575e5c service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1741235 Dec 09 14:43:14.876263 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] Made reservation on behalf of 21222e8023f9407d8236cc1fedf88c2a for: {'network': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:43:14.881139 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:14.905271 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:14.977872 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:14.990411 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-35b975c9-4ea7-4143-b809-f8fb668ad02a req-5dfd3ede-ac9d-4d9b-b5d6-65379dc8a809 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1736629 Dec 09 14:43:15.012684 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-58592371-b593-496a-b386-38e2d83e6b70 req-ff55c046-0904-419b-bbf3-5e301e83dd16 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2060947 Dec 09 14:43:15.045338 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f08c5df4-b19f-4202-aef2-37ddccbf0cd1 req-33204621-3a68-43a9-82cb-c6925f85cf1c service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1783297 Dec 09 14:43:15.049728 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ffa48f2-a9a4-460f-9913-6ffb7884f44f req-8952c9dc-3366-44c7-a9e3-2fa7857fa572 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:15.051278 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0ffa48f2-a9a4-460f-9913-6ffb7884f44f req-8952c9dc-3366-44c7-a9e3-2fa7857fa572 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 946 time: 0.0890195 Dec 09 14:43:15.087599 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:15.097380 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:15.140054 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 410} {{(pid=109062) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:43:15.151638 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0ffa48f2-a9a4-460f-9913-6ffb7884f44f req-985d7442-07fe-49b9-ba73-cec1b9ea0caa tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0886774 Dec 09 14:43:15.153620 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=420aabf8-337b-4459-8e5f-41d51dbc13f8,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:15.159814 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:15.160162 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.segments_db [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] Added segment f73b720a-604f-46ed-aa6c-972d78566733 of type vlan for network 7c89e0f7-1db1-4696-bb02-eab2b42330b3 Dec 09 14:43:15.205908 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44710cdd-2127-4ded-b058-9b4212b42f28 req-c9e3e605-887e-471c-9df5-259384b2f773 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:15.207443 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-44710cdd-2127-4ded-b058-9b4212b42f28 req-c9e3e605-887e-471c-9df5-259384b2f773 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0634499 Dec 09 14:43:15.210165 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:15.237232 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:15.238192 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:15.238899 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:15.291390 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.6581593 Dec 09 14:43:15.294233 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52774) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:15.300728 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-d956a701-937f-4964-a517-cd7b4677117a admin admin] Request body: {'subnet': {'network_id': '7c89e0f7-1db1-4696-bb02-eab2b42330b3', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1234523634-subnet', 'tenant_id': '21222e8023f9407d8236cc1fedf88c2a', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:15.309304 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8ea030e-c714-4989-b298-dc5fee3cb5ad admin admin] Pushing event updated for resources: {'Network': ['ID=7c89e0f7-1db1-4696-bb02-eab2b42330b3,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:15.311888 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-44710cdd-2127-4ded-b058-9b4212b42f28 req-783af082-d96b-498f-8af0-a64be4dc8b35 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0974951 Dec 09 14:43:15.323231 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network 7c89e0f7-1db1-4696-bb02-eab2b42330b3 details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:43:15.328454 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d956a701-937f-4964-a517-cd7b4677117a admin admin] Made reservation on behalf of 21222e8023f9407d8236cc1fedf88c2a for: {'subnet': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:43:15.331075 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d956a701-937f-4964-a517-cd7b4677117a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-130588657'] for subnet, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:15.396589 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f08c5df4-b19f-4202-aef2-37ddccbf0cd1 req-3625e71d-c86b-4a60-8c28-4cbc21c9120b service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1649177 Dec 09 14:43:15.550296 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d956a701-937f-4964-a517-cd7b4677117a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-130461295', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-130768923'] for subnet, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:15.606142 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d956a701-937f-4964-a517-cd7b4677117a admin admin] Pushing event updated for resources: {'Subnet': ['ID=9c9610d7-432c-4800-81dd-563520bc1c74,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:15.621623 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d956a701-937f-4964-a517-cd7b4677117a admin admin] Checking segment: {'id': 'f73b720a-604f-46ed-aa6c-972d78566733', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 410, 'network_id': '7c89e0f7-1db1-4696-bb02-eab2b42330b3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109062) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:43:15.621983 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d956a701-937f-4964-a517-cd7b4677117a admin admin] Network hostable DHCP agents. Network: 7c89e0f7-1db1-4696-bb02-eab2b42330b3, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109062) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:43:15.640137 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d956a701-937f-4964-a517-cd7b4677117a admin admin] Network 7c89e0f7-1db1-4696-bb02-eab2b42330b3 is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109062) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:43:15.649698 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-d956a701-937f-4964-a517-cd7b4677117a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, 7c89e0f7-1db1-4696-bb02-eab2b42330b3) {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:43:15.654265 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d956a701-937f-4964-a517-cd7b4677117a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:15.655054 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d956a701-937f-4964-a517-cd7b4677117a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:15.659597 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8dd23654-7efe-4cc4-a0f2-d62529242821 None None] Network 7c89e0f7-1db1-4696-bb02-eab2b42330b3 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:43:15.674049 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-d956a701-937f-4964-a517-cd7b4677117a admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3787820 Dec 09 14:43:15.760758 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1372490a-8130-411b-8a6a-57f9a75daa80 None None] Network 7c89e0f7-1db1-4696-bb02-eab2b42330b3 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:43:15.828174 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d0e447-f906-4e1c-ba31-9e0683f34732 req-4e79ce22-619a-42e7-ad4c-bee765882696 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:15.829673 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-20d0e447-f906-4e1c-ba31-9e0683f34732 req-4e79ce22-619a-42e7-ad4c-bee765882696 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 943 time: 0.0509739 Dec 09 14:43:15.880891 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-20d0e447-f906-4e1c-ba31-9e0683f34732 req-d23eda8a-113c-48b7-89e4-8a4dbf4a7197 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452435 Dec 09 14:43:16.098984 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bfd21b1-827d-4c12-b3cb-a55bbc3f32bd req-73bec2ab-2197-401f-9cf6-fc2739940b78 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:16.112015 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7bfd21b1-827d-4c12-b3cb-a55bbc3f32bd req-73bec2ab-2197-401f-9cf6-fc2739940b78 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 943 time: 0.0658331 Dec 09 14:43:16.165180 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7bfd21b1-827d-4c12-b3cb-a55bbc3f32bd req-b742e921-125e-4c3b-a259-2d47651333ba tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0519629 Dec 09 14:43:16.206425 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 52810) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:16.212141 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1278015952-network', 'tenant_id': '9c9bd5ee9cd9458e8b4df2da065cfa12'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:16.214062 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:43:16.243441 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] Made reservation on behalf of 9c9bd5ee9cd9458e8b4df2da065cfa12 for: {'network': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:43:16.247550 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:16.260271 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:16.335222 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6,segment=NetworkSegment(7ece4ded-a169-4d54-b911-54a5a65cd0ce),segment_id=7ece4ded-a169-4d54-b911-54a5a65cd0ce)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:16.349483 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': '2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6', 'network_id': '8ff38a1e-5122-4806-8b7d-d4c281cbe550', 'port_id': '2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6', 'mac_address': 'fa:16:3e:30:46:6e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 425, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '90388423-2d07-4cbe-80d8-fa2f6a3c14f7', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:43:16.401354 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:16.408561 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:16.417720 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:16.435807 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:43:16.462547 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6,segment=NetworkSegment(7ece4ded-a169-4d54-b911-54a5a65cd0ce),segment_id=7ece4ded-a169-4d54-b911-54a5a65cd0ce)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:16.468030 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:16.469128 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device c5d8b8cc-2c67-46a7-867d-276136fccdf1 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:43:16.469314 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 443} {{(pid=109061) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:43:16.489441 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d5976f9b-3b61-42c9-bf40-eed3fbbdc9b3,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:16.505377 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:16.505750 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.segments_db [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] Added segment 8b94d131-b7a5-411f-b4ad-4b8360f12271 of type vlan for network 4ff9fb6e-1991-4952-8fc0-ebf53225fd28 Dec 09 14:43:16.507115 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2b517cb-e19a-4664-8dbc-15bb151825f6 req-2161906e-12e3-45dd-8614-52bdfea6380e tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:16.516322 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b2b517cb-e19a-4664-8dbc-15bb151825f6 req-2161906e-12e3-45dd-8614-52bdfea6380e tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0738893 Dec 09 14:43:16.558221 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:16.561391 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1f65f6b5-f1b4-4b7d-b9c2-0a75f8926217" -d '{"events": [{"server_uuid": "a8ee2ec0-d1d7-458d-ae2a-509098efff13", "name": "network-vif-plugged", "status": "completed", "tag": "eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:16.585068 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b2b517cb-e19a-4664-8dbc-15bb151825f6 req-88ceb977-2647-4547-9d59-d96d16fb0464 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0676436 Dec 09 14:43:16.608645 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:16.633104 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:16.661067 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-167d3b6b-e028-4b53-bcbf-7473fa171461 x-openstack-request-id: req-167d3b6b-e028-4b53-bcbf-7473fa171461 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:16.661427 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a8ee2ec0-d1d7-458d-ae2a-509098efff13", "name": "network-vif-plugged", "status": "completed", "tag": "eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:16.661687 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-167d3b6b-e028-4b53-bcbf-7473fa171461 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:16.662095 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'code': 200} Dec 09 14:43:16.676216 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:16.677573 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:16.678370 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:16.693040 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port c5d8b8cc-2c67-46a7-867d-276136fccdf1, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=c5d8b8cc-2c67-46a7-867d-276136fccdf1,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:16.706768 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': 'c5d8b8cc-2c67-46a7-867d-276136fccdf1', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'port_id': 'c5d8b8cc-2c67-46a7-867d-276136fccdf1', 'mac_address': 'fa:16:3e:5b:b5:d9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 442, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:43:16.761058 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:16.764230 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.5560024 Dec 09 14:43:16.765219 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af9a8fdd-b058-401d-8697-66816efc82ed admin admin] Pushing event updated for resources: {'Network': ['ID=4ff9fb6e-1991-4952-8fc0-ebf53225fd28,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:16.766748 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52842) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:16.772995 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-eaf0b0b9-37e8-43ff-aa2a-e0035b08e4f5 admin admin] Request body: {'subnet': {'network_id': '4ff9fb6e-1991-4952-8fc0-ebf53225fd28', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1278015952-subnet', 'tenant_id': '9c9bd5ee9cd9458e8b4df2da065cfa12', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:16.778073 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network 4ff9fb6e-1991-4952-8fc0-ebf53225fd28 details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:43:16.796607 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eaf0b0b9-37e8-43ff-aa2a-e0035b08e4f5 admin admin] Made reservation on behalf of 9c9bd5ee9cd9458e8b4df2da065cfa12 for: {'subnet': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:43:16.799307 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-eaf0b0b9-37e8-43ff-aa2a-e0035b08e4f5 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-130588657'] for subnet, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:16.821928 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c5d8b8cc-2c67-46a7-867d-276136fccdf1 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:43:16.864839 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port c5d8b8cc-2c67-46a7-867d-276136fccdf1, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=c5d8b8cc-2c67-46a7-867d-276136fccdf1,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:16.873011 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:16.883944 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a018353f-abd5-4b23-8edf-d86a7b7abe1c req-4ee0e759-a7fa-4b3e-bfa0-79f1768fc949 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:16.886182 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a018353f-abd5-4b23-8edf-d86a7b7abe1c req-4ee0e759-a7fa-4b3e-bfa0-79f1768fc949 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 1099 time: 0.0671823 Dec 09 14:43:16.957444 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a018353f-abd5-4b23-8edf-d86a7b7abe1c req-98009cc5-a1ec-4879-a15a-22169413a4e2 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0631289 Dec 09 14:43:17.037827 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3d0f9e3-26db-443e-98da-1867cbbc7514 req-506f6359-8e66-4429-a12e-1490878d3dae tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:17.046548 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c3d0f9e3-26db-443e-98da-1867cbbc7514 req-506f6359-8e66-4429-a12e-1490878d3dae tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 944 time: 0.0635278 Dec 09 14:43:17.070234 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-eaf0b0b9-37e8-43ff-aa2a-e0035b08e4f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-130461295', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-130768923'] for subnet, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:17.077720 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=c5d8b8cc-2c67-46a7-867d-276136fccdf1,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:17.093754 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c3d0f9e3-26db-443e-98da-1867cbbc7514 req-1fac3afc-72ef-4cf6-b8af-6a61012eb116 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461700 Dec 09 14:43:17.128780 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaf0b0b9-37e8-43ff-aa2a-e0035b08e4f5 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5d42783b-3eca-442a-bfe6-fa256008fdf8,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:17.143317 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eaf0b0b9-37e8-43ff-aa2a-e0035b08e4f5 admin admin] Checking segment: {'id': '8b94d131-b7a5-411f-b4ad-4b8360f12271', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 443, 'network_id': '4ff9fb6e-1991-4952-8fc0-ebf53225fd28'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109062) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:43:17.143711 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eaf0b0b9-37e8-43ff-aa2a-e0035b08e4f5 admin admin] Network hostable DHCP agents. Network: 4ff9fb6e-1991-4952-8fc0-ebf53225fd28, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109062) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:43:17.160557 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eaf0b0b9-37e8-43ff-aa2a-e0035b08e4f5 admin admin] Network 4ff9fb6e-1991-4952-8fc0-ebf53225fd28 is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109062) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:43:17.169928 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-eaf0b0b9-37e8-43ff-aa2a-e0035b08e4f5 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, 4ff9fb6e-1991-4952-8fc0-ebf53225fd28) {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:43:17.173807 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eaf0b0b9-37e8-43ff-aa2a-e0035b08e4f5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:17.174403 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-eaf0b0b9-37e8-43ff-aa2a-e0035b08e4f5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:17.178606 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-452584b1-e6a1-4561-90b0-0f566af82fb4 None None] Network 4ff9fb6e-1991-4952-8fc0-ebf53225fd28 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:43:17.190840 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-eaf0b0b9-37e8-43ff-aa2a-e0035b08e4f5 admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.4227824 Dec 09 14:43:17.200786 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['c5d8b8cc-2c67-46a7-867d-276136fccdf1'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:43:17.241051 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:43:17.293907 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3d20544-147c-4798-a49d-5d2c3d0112dc req-40c4be2e-209c-49e2-90d9-56caee7156b1 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:17.295409 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d3d20544-147c-4798-a49d-5d2c3d0112dc req-40c4be2e-209c-49e2-90d9-56caee7156b1 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 944 time: 0.0507374 Dec 09 14:43:17.346487 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d3d20544-147c-4798-a49d-5d2c3d0112dc req-c2cb0625-2dee-4013-997c-e29cc371ff4c tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447941 Dec 09 14:43:17.391281 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f0393e9-f62d-4b64-a17b-b874a5203d43 None None] Network 4ff9fb6e-1991-4952-8fc0-ebf53225fd28 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:43:17.740515 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2862723f-3ece-4522-9340-7c928d61781f req-3f7578ee-ec52-4515-a3d8-022c29950f9b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:17.742193 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2862723f-3ece-4522-9340-7c928d61781f req-3f7578ee-ec52-4515-a3d8-022c29950f9b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0776300 Dec 09 14:43:17.800406 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2862723f-3ece-4522-9340-7c928d61781f req-addd9a03-5c7c-4e22-8762-8f83bf70777e tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515106 Dec 09 14:43:18.225676 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4478d417-f9c4-410d-95c4-8aa3e55f6933 req-8230e94e-77dd-4ad3-a91d-ddba5b0389ac tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:18.227240 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4478d417-f9c4-410d-95c4-8aa3e55f6933 req-8230e94e-77dd-4ad3-a91d-ddba5b0389ac tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 944 time: 0.0616393 Dec 09 14:43:18.274549 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4478d417-f9c4-410d-95c4-8aa3e55f6933 req-0e2c4e02-e116-4f0a-ba6f-0bb44eb48a1d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413992 Dec 09 14:43:18.470142 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54e58bc9-81e5-4667-aa67-4f804c8e0afc req-62085410-ea70-473b-a5b2-b683215b0432 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:18.471696 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-54e58bc9-81e5-4667-aa67-4f804c8e0afc req-62085410-ea70-473b-a5b2-b683215b0432 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 944 time: 0.0536757 Dec 09 14:43:18.524721 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-54e58bc9-81e5-4667-aa67-4f804c8e0afc req-ceff99dc-faf4-465b-b7b8-383e7da6cccc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464399 Dec 09 14:43:18.539210 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52914) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:18.642709 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7373dd7b-fb2a-4a64-b0d7-43681887d8b0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:18.730036 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7373dd7b-fb2a-4a64-b0d7-43681887d8b0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:18.735152 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7373dd7b-fb2a-4a64-b0d7-43681887d8b0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:18.771324 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7373dd7b-fb2a-4a64-b0d7-43681887d8b0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ee982a33-94f7-46aa-ae37-0cc8dca8e3de,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:18.776932 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-7373dd7b-fb2a-4a64-b0d7-43681887d8b0 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=98adcff9d31942e39ba93a18cd4e51a2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2366567 Dec 09 14:43:18.779854 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 52922) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:18.830841 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b0bafb2a-6325-4d59-81af-2600eb725cc7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:18.855854 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b0bafb2a-6325-4d59-81af-2600eb725cc7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:18.917138 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b0bafb2a-6325-4d59-81af-2600eb725cc7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:18.921280 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b0bafb2a-6325-4d59-81af-2600eb725cc7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:18.924310 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-b0bafb2a-6325-4d59-81af-2600eb725cc7 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/ee982a33-94f7-46aa-ae37-0cc8dca8e3de HTTP/1.1" status: 204 len: 168 time: 0.1435621 Dec 09 14:43:18.936463 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ea91223-ae27-47ab-b9e7-d63de0f745a7 req-16a5f045-c1e1-4c84-aa9c-f055e836b961 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:18.938399 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7ea91223-ae27-47ab-b9e7-d63de0f745a7 req-16a5f045-c1e1-4c84-aa9c-f055e836b961 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0606360 Dec 09 14:43:18.944397 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0bafb2a-6325-4d59-81af-2600eb725cc7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ee982a33-94f7-46aa-ae37-0cc8dca8e3de,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:18.998437 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7ea91223-ae27-47ab-b9e7-d63de0f745a7 req-99814681-840a-404e-a334-74848d3b412f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0531490 Dec 09 14:43:19.123253 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a634ea93-e2e6-4b72-b76d-5c046403cc22 req-b3fff51e-413b-4bd2-86f6-b1d52ca4162c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:19.124795 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a634ea93-e2e6-4b72-b76d-5c046403cc22 req-b3fff51e-413b-4bd2-86f6-b1d52ca4162c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0503273 Dec 09 14:43:19.133659 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 52944) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:19.138387 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-0ab34482-c544-4b9d-87e1-9dcb089e5ee2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Request body: {'floatingip': {'port_id': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:19.213936 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0ab34482-c544-4b9d-87e1-9dcb089e5ee2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for floatingip, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:19.283812 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 52952) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:19.297525 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4535b975-d0a3-4499-bd2e-b8f0e1384056 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:19.383531 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4535b975-d0a3-4499-bd2e-b8f0e1384056 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:19.388715 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4535b975-d0a3-4499-bd2e-b8f0e1384056 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:19.430956 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-4535b975-d0a3-4499-bd2e-b8f0e1384056 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=99a10ff1ce874885a052b07cde818dc4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1459405 Dec 09 14:43:19.433614 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 52956) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:19.439876 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4535b975-d0a3-4499-bd2e-b8f0e1384056 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=05fff282-6678-4fc7-bb1d-4e24550d4f47,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:19.485780 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-57943309-309e-47b1-8347-0dc3b97732e9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:19.507970 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-57943309-309e-47b1-8347-0dc3b97732e9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:19.570563 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-57943309-309e-47b1-8347-0dc3b97732e9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:19.573373 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-57943309-309e-47b1-8347-0dc3b97732e9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:19.577150 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-57943309-309e-47b1-8347-0dc3b97732e9 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/05fff282-6678-4fc7-bb1d-4e24550d4f47 HTTP/1.1" status: 204 len: 168 time: 0.1400375 Dec 09 14:43:19.579073 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caa130c4-909b-4f66-be62-b0d80c82fd2f req-7ab776c8-bcb5-4e95-a360-f5b91cea0a1d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:19.580331 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-caa130c4-909b-4f66-be62-b0d80c82fd2f req-7ab776c8-bcb5-4e95-a360-f5b91cea0a1d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 944 time: 0.0937581 Dec 09 14:43:19.589851 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57943309-309e-47b1-8347-0dc3b97732e9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=05fff282-6678-4fc7-bb1d-4e24550d4f47,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:19.657458 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f382ecce-9fce-444c-80fb-758814b9a349 req-84d790a8-880d-44d9-b1aa-0a16b579ed57 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:19.660065 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f382ecce-9fce-444c-80fb-758814b9a349 req-84d790a8-880d-44d9-b1aa-0a16b579ed57 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 944 time: 0.0548847 Dec 09 14:43:19.703160 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-caa130c4-909b-4f66-be62-b0d80c82fd2f req-ba737b16-3479-403a-882a-cc6dd9acf708 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0848539 Dec 09 14:43:19.731704 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f382ecce-9fce-444c-80fb-758814b9a349 req-29f137a2-f3e7-4114-b38c-c4b024f8b35e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0666842 Dec 09 14:43:19.937184 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 52966) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:19.951630 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-27bd1934-5f0f-4200-8b4e-1014bd8a7939 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.029298 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-27bd1934-5f0f-4200-8b4e-1014bd8a7939 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.034493 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-27bd1934-5f0f-4200-8b4e-1014bd8a7939 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.074690 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-27bd1934-5f0f-4200-8b4e-1014bd8a7939 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=7eacc633591048a3b4fff64b385741ee&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1363668 Dec 09 14:43:20.075708 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27bd1934-5f0f-4200-8b4e-1014bd8a7939 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ad7ad8e-44ae-4bec-85ee-15327eda9167,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:20.078101 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 52972) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:20.118175 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0ab34482-c544-4b9d-87e1-9dcb089e5ee2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.123231 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0ab34482-c544-4b9d-87e1-9dcb089e5ee2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.138799 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-062cacb2-5c3c-4c02-a73e-a9ec13f00e04 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.163562 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-062cacb2-5c3c-4c02-a73e-a9ec13f00e04 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.212085 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-062cacb2-5c3c-4c02-a73e-a9ec13f00e04 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.214927 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-062cacb2-5c3c-4c02-a73e-a9ec13f00e04 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.216150 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-062cacb2-5c3c-4c02-a73e-a9ec13f00e04 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/0ad7ad8e-44ae-4bec-85ee-15327eda9167 HTTP/1.1" status: 204 len: 168 time: 0.1355004 Dec 09 14:43:20.224564 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-062cacb2-5c3c-4c02-a73e-a9ec13f00e04 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ad7ad8e-44ae-4bec-85ee-15327eda9167,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:20.225499 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.l3_db [None req-0ab34482-c544-4b9d-87e1-9dcb089e5ee2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Floating IP dd85f982-92bb-456b-a1d1-1eb7afd674e2 associated. External IP: 172.27.0.157, port: eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7. Dec 09 14:43:20.249084 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:43:20.316810 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:43:20.320884 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:20.321270 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.413348 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.450111 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6,segment=NetworkSegment(7ece4ded-a169-4d54-b911-54a5a65cd0ce),segment_id=7ece4ded-a169-4d54-b911-54a5a65cd0ce)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:20.451351 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a496d15e-076c-47a9-9cc3-a0e61bed5ae0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:20.454386 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8e0ada2c-7d61-49bd-9556-738c40fcc0c9" -d '{"events": [{"server_uuid": "a496d15e-076c-47a9-9cc3-a0e61bed5ae0", "name": "network-vif-plugged", "status": "completed", "tag": "2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:20.460431 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0ab34482-c544-4b9d-87e1-9dcb089e5ee2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:43:20.470677 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.477059 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device c5d8b8cc-2c67-46a7-867d-276136fccdf1 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:43:20.561624 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-41ab6de7-45cf-4a42-917d-9bccf09309cc x-openstack-request-id: req-41ab6de7-45cf-4a42-917d-9bccf09309cc {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:20.562473 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a496d15e-076c-47a9-9cc3-a0e61bed5ae0", "name": "network-vif-plugged", "status": "completed", "tag": "2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:20.563155 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-41ab6de7-45cf-4a42-917d-9bccf09309cc {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:20.564031 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a496d15e-076c-47a9-9cc3-a0e61bed5ae0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6', 'code': 200} Dec 09 14:43:20.565362 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:20.680503 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0ab34482-c544-4b9d-87e1-9dcb089e5ee2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:43:20.681823 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port c5d8b8cc-2c67-46a7-867d-276136fccdf1 completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:43:20.686929 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port c5d8b8cc-2c67-46a7-867d-276136fccdf1 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:20.687687 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.690254 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0ab34482-c544-4b9d-87e1-9dcb089e5ee2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.700045 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d585cf0-6e39-4a81-934c-5b7f765c829b None None] Sync routers for ids ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:43:20.715931 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d585cf0-6e39-4a81-934c-5b7f765c829b None None] Routers {'49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:43:20.722542 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-8d585cf0-6e39-4a81-934c-5b7f765c829b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:42:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:20.757073 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-0ab34482-c544-4b9d-87e1-9dcb089e5ee2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "PUT /v2.0/floatingips/dd85f982-92bb-456b-a1d1-1eb7afd674e2 HTTP/1.1" status: 200 len: 992 time: 1.6222792 Dec 09 14:43:20.757903 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'tag': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7'}] {{(pid=109062) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:20.765281 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3f1ec408b0eec5a36b56e0a757eff0f4875d9a95eff62f4d0b4a62bb27a3b600" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-37a5f508-0362-4598-b705-ec3b55f23e78" -d '{"events": [{"name": "network-changed", "server_uuid": "a8ee2ec0-d1d7-458d-ae2a-509098efff13", "tag": "eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7"}]}' {{(pid=109062) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:20.832995 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.858873 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-8d585cf0-6e39-4a81-934c-5b7f765c829b None None] Set router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:43:20.919733 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54958f8e-6c25-4841-88e3-eae715a4d6e8 req-0877ff6d-82d3-4012-a3fb-ca4077a9e83a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:20.924674 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-54958f8e-6c25-4841-88e3-eae715a4d6e8 req-0877ff6d-82d3-4012-a3fb-ca4077a9e83a service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 1098 time: 0.1235213 Dec 09 14:43:20.931961 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port c5d8b8cc-2c67-46a7-867d-276136fccdf1, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=c5d8b8cc-2c67-46a7-867d-276136fccdf1,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:20.933013 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b918610-1030-46b5-b8e6-4d522f74c138 req-8758ba73-a3e2-4fd8-8618-18dda4167af2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:20.935621 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1b918610-1030-46b5-b8e6-4d522f74c138 req-8758ba73-a3e2-4fd8-8618-18dda4167af2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 944 time: 0.0981603 Dec 09 14:43:20.941413 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:20.948620 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b86c9d09-9d7d-40b2-b113-5e523478be2e req-4a473bc2-b530-43e5-a338-82208874475a tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:20.957479 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b86c9d09-9d7d-40b2-b113-5e523478be2e req-4a473bc2-b530-43e5-a338-82208874475a tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.1376114 Dec 09 14:43:20.999726 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1b918610-1030-46b5-b8e6-4d522f74c138 req-e5f8ace3-e5ea-407c-85c7-e25b7ca73290 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0566735 Dec 09 14:43:21.033337 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=c5d8b8cc-2c67-46a7-867d-276136fccdf1,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:21.060275 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-54958f8e-6c25-4841-88e3-eae715a4d6e8 req-2908c3ea-a9cd-4af9-90ac-3b687762972e service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1004200 Dec 09 14:43:21.064149 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b86c9d09-9d7d-40b2-b113-5e523478be2e req-a5b40efa-c4f3-4c26-99fb-6d9e8a9ebd12 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957823 Dec 09 14:43:21.120586 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1e944a5a-fb4e-4882-b7d8-325a7f22fc4d x-openstack-request-id: req-1e944a5a-fb4e-4882-b7d8-325a7f22fc4d {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:21.120891 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a8ee2ec0-d1d7-458d-ae2a-509098efff13", "tag": "eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7", "status": "completed", "code": 200}]} {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:21.121149 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-1e944a5a-fb4e-4882-b7d8-325a7f22fc4d {{(pid=109062) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:21.121550 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'tag': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'status': 'completed', 'code': 200} Dec 09 14:43:21.163006 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-8d585cf0-6e39-4a81-934c-5b7f765c829b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': 'dd85f982-92bb-456b-a1d1-1eb7afd674e2', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'floating_ip_address': '172.27.0.157', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'port_id': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 126, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'mac_address': 'fa:16:3e:50:6b:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:42:50Z', 'updated_at': '2021-12-09T14:43:19Z', 'revision_number': 1, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6db4124e-4bda-4bda-b604-9b9706732691', 'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'mac_address': 'fa:16:3e:7f:fb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 5, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'subnets': [{'id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:21.191383 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d585cf0-6e39-4a81-934c-5b7f765c829b None None] Checking router: 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:43:21.199812 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8d585cf0-6e39-4a81-934c-5b7f765c829b None None] Routers {'49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:43:21.200415 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-8d585cf0-6e39-4a81-934c-5b7f765c829b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:42:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:21.316095 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-8d585cf0-6e39-4a81-934c-5b7f765c829b None None] Set router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:43:21.397456 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37a5f508-0362-4598-b705-ec3b55f23e78 req-4bd66b21-46ee-4fef-aee7-b580d999dc99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:21.399031 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-37a5f508-0362-4598-b705-ec3b55f23e78 req-4bd66b21-46ee-4fef-aee7-b580d999dc99 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=6be5d78d2d0049448c3947b4e650758a&device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 1099 time: 0.0563383 Dec 09 14:43:21.503637 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37a5f508-0362-4598-b705-ec3b55f23e78 req-24a31b06-718f-4809-81f7-cb8537ffca2f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:21.505369 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-37a5f508-0362-4598-b705-ec3b55f23e78 req-24a31b06-718f-4809-81f7-cb8537ffca2f service neutron] 10.222.0.44 "GET /v2.0/networks?id=9ab3f8b6-44d0-4210-907d-0e96072c4566 HTTP/1.1" status: 200 len: 917 time: 0.0865152 Dec 09 14:43:21.548462 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-8d585cf0-6e39-4a81-934c-5b7f765c829b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': 'dd85f982-92bb-456b-a1d1-1eb7afd674e2', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'floating_ip_address': '172.27.0.157', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'port_id': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 126, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'mac_address': 'fa:16:3e:50:6b:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:42:50Z', 'updated_at': '2021-12-09T14:43:19Z', 'revision_number': 1, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6db4124e-4bda-4bda-b604-9b9706732691', 'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'mac_address': 'fa:16:3e:7f:fb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 5, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'subnets': [{'id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:21.579593 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8d585cf0-6e39-4a81-934c-5b7f765c829b None None] The sync data for ids ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'] in dv-cinder-819692-8-iscsi is: [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': 'dd85f982-92bb-456b-a1d1-1eb7afd674e2', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'floating_ip_address': '172.27.0.157', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'port_id': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 126, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'mac_address': 'fa:16:3e:50:6b:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:42:50Z', 'updated_at': '2021-12-09T14:43:19Z', 'revision_number': 1, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6db4124e-4bda-4bda-b604-9b9706732691', 'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'mac_address': 'fa:16:3e:7f:fb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 5, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'subnets': [{'id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:43:21.624155 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-37a5f508-0362-4598-b705-ec3b55f23e78 req-545c2ff2-9a47-4c55-9f21-c82081addb4d service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 HTTP/1.1" status: 200 len: 1000 time: 0.1020501 Dec 09 14:43:21.699805 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37a5f508-0362-4598-b705-ec3b55f23e78 req-645152a8-b595-4aea-9e1b-0c94dc179979 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:21.701422 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-37a5f508-0362-4598-b705-ec3b55f23e78 req-645152a8-b595-4aea-9e1b-0c94dc179979 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=f10f1097-5d43-4737-bcac-a27ade66b442 HTTP/1.1" status: 200 len: 855 time: 0.0608363 Dec 09 14:43:21.761676 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37a5f508-0362-4598-b705-ec3b55f23e78 req-0259ea33-70f1-4348-b4cd-59f81af89eed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:21.763706 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-37a5f508-0362-4598-b705-ec3b55f23e78 req-0259ea33-70f1-4348-b4cd-59f81af89eed service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=9ab3f8b6-44d0-4210-907d-0e96072c4566&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0472958 Dec 09 14:43:21.863657 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b88efb76-f026-4ce1-a8a3-42380ca67c8f None None] New status for floating IP dd85f982-92bb-456b-a1d1-1eb7afd674e2: ACTIVE {{(pid=109063) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:43:21.906430 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-37a5f508-0362-4598-b705-ec3b55f23e78 req-df4d6893-39a0-4f79-94ba-1d9594ab5bca service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1231878 Dec 09 14:43:22.025431 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-37a5f508-0362-4598-b705-ec3b55f23e78 req-6fce1b3c-1777-4fef-923a-ced4abe3a185 service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1047425 Dec 09 14:43:22.141596 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac7002cb-c81d-4492-9137-d1f85512140e req-39b410a4-8dcd-4d47-93c9-40f964ea1c68 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:22.143863 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ac7002cb-c81d-4492-9137-d1f85512140e req-39b410a4-8dcd-4d47-93c9-40f964ea1c68 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0617290 Dec 09 14:43:22.220193 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ac7002cb-c81d-4492-9137-d1f85512140e req-eb6ec894-75a9-42e4-86ef-4478d704c659 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0639758 Dec 09 14:43:22.235680 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98efb700-ef52-4902-b08a-319b6e0d8caa req-ad224dd3-c89a-48fa-b726-f691557596c3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:22.240145 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-98efb700-ef52-4902-b08a-319b6e0d8caa req-ad224dd3-c89a-48fa-b726-f691557596c3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0603821 Dec 09 14:43:22.283953 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-98efb700-ef52-4902-b08a-319b6e0d8caa req-01407b2d-79a7-4421-91d7-56ef3fb58eaa tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404205 Dec 09 14:43:22.565614 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '31f6f258-99da-4d63-b6dd-0b20015bf98e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c5d8b8cc-2c67-46a7-867d-276136fccdf1'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:22.568348 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c2a48c35-a46f-4445-be81-7b4a98cd755e" -d '{"events": [{"server_uuid": "31f6f258-99da-4d63-b6dd-0b20015bf98e", "name": "network-vif-plugged", "status": "completed", "tag": "c5d8b8cc-2c67-46a7-867d-276136fccdf1"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:22.605814 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ff1b8fad-ca76-4489-88b0-d368bbfa4d7a x-openstack-request-id: req-ff1b8fad-ca76-4489-88b0-d368bbfa4d7a {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:22.606178 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "31f6f258-99da-4d63-b6dd-0b20015bf98e", "name": "network-vif-plugged", "status": "completed", "tag": "c5d8b8cc-2c67-46a7-867d-276136fccdf1", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:22.606473 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-ff1b8fad-ca76-4489-88b0-d368bbfa4d7a {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:22.606997 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '31f6f258-99da-4d63-b6dd-0b20015bf98e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c5d8b8cc-2c67-46a7-867d-276136fccdf1', 'code': 200} Dec 09 14:43:22.882620 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-645cfa4b-524b-4257-838f-7dae6b5489f9 req-4c2a5a26-3766-42e7-8c74-5dab41950c2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:22.884702 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-645cfa4b-524b-4257-838f-7dae6b5489f9 req-4c2a5a26-3766-42e7-8c74-5dab41950c2e service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 1098 time: 0.0412574 Dec 09 14:43:22.958938 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-645cfa4b-524b-4257-838f-7dae6b5489f9 req-58e13109-d3be-476e-959a-36fe0db5cc37 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0581887 Dec 09 14:43:23.343190 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96ea1dac-b375-4017-9ece-de81c4ca5b45 req-0a7edaac-f99f-4dc0-9524-33dd11fad593 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:23.344680 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-96ea1dac-b375-4017-9ece-de81c4ca5b45 req-0a7edaac-f99f-4dc0-9524-33dd11fad593 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0461059 Dec 09 14:43:23.391546 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-96ea1dac-b375-4017-9ece-de81c4ca5b45 req-21845a05-7292-4610-aabc-c7f11a4580ed tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0406637 Dec 09 14:43:23.398459 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15057151-3dae-44ac-87a4-b94dfe97331d req-f4c288e5-4e87-45c9-ab8a-229c40b59098 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:23.399950 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-15057151-3dae-44ac-87a4-b94dfe97331d req-f4c288e5-4e87-45c9-ab8a-229c40b59098 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/networks?id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d HTTP/1.1" status: 200 len: 815 time: 0.1013527 Dec 09 14:43:23.416508 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-15057151-3dae-44ac-87a4-b94dfe97331d req-6111c6ca-75b1-4de5-bda8-e97f8dcdecd8 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/quotas/5ec989b7fd3e45f2b8962e012b0797ac HTTP/1.1" status: 200 len: 375 time: 0.0103221 Dec 09 14:43:23.467497 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-15057151-3dae-44ac-87a4-b94dfe97331d req-1c489b47-7772-4e50-b8db-ed2fd7e64928 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=5ec989b7fd3e45f2b8962e012b0797ac&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0447028 Dec 09 14:43:23.500439 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a4f2a68-7b75-4eb8-ad11-b4306e797ad2 req-021b891c-e8bb-403b-bd65-c617defd33b9 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:23.501943 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2a4f2a68-7b75-4eb8-ad11-b4306e797ad2 req-021b891c-e8bb-403b-bd65-c617defd33b9 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0558424 Dec 09 14:43:23.547653 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2a4f2a68-7b75-4eb8-ad11-b4306e797ad2 req-e636bb30-5e07-49b5-8c9c-34f5562004da tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395486 Dec 09 14:43:23.565638 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-15057151-3dae-44ac-87a4-b94dfe97331d req-16f1ba5b-9fcf-47fe-a5cb-ba50dfc7432c service neutron] 10.222.0.39 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0880797 Dec 09 14:43:23.657228 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-15057151-3dae-44ac-87a4-b94dfe97331d req-2856cf37-8f73-449e-a924-4370bd2a1025 service neutron] 10.222.0.39 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0848179 Dec 09 14:43:23.982900 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9a97d830-b00f-4ab5-bfcd-f3ccdd0e297d req-a185654c-6803-411c-82a2-07f587dbe593 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 210 time: 0.0333266 Dec 09 14:43:24.092954 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b09a17-4ff7-4902-ad59-e15e1c1faea4 req-0314f032-846b-4d88-9567-84fa7e26342f tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:24.094685 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f1b09a17-4ff7-4902-ad59-e15e1c1faea4 req-0314f032-846b-4d88-9567-84fa7e26342f tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0496037 Dec 09 14:43:24.145724 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f1b09a17-4ff7-4902-ad59-e15e1c1faea4 req-31fb2e51-0953-454b-8d0d-a20a6e52f5ac tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447276 Dec 09 14:43:24.518883 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ce64ff-fba2-4d86-b07b-b377911d8345 req-3764502c-4732-4989-851e-8a4547363620 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:24.520402 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b2ce64ff-fba2-4d86-b07b-b377911d8345 req-3764502c-4732-4989-851e-8a4547363620 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0503087 Dec 09 14:43:24.567549 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b2ce64ff-fba2-4d86-b07b-b377911d8345 req-5eec5bb5-6eff-4957-a065-92d1fb3de30a tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0409400 Dec 09 14:43:25.080591 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a5406fdf-2877-4c0a-bc10-bc034e2e080a req-20ac67dc-e767-43e3-a94e-61fa3d0af08a tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 210 time: 0.0253289 Dec 09 14:43:25.271316 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aaff6f5-2d92-4831-b1aa-9a856cdaef5a req-91c31653-97dc-41d5-9fda-ef6a60d30e46 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:25.272667 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4aaff6f5-2d92-4831-b1aa-9a856cdaef5a req-91c31653-97dc-41d5-9fda-ef6a60d30e46 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0515082 Dec 09 14:43:25.324172 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4aaff6f5-2d92-4831-b1aa-9a856cdaef5a req-eb98fad1-0bab-423b-a1ea-8d8959185fe0 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428288 Dec 09 14:43:25.691014 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed6224c9-8733-4a05-a166-8255550421ce req-6dc93508-3945-466e-b505-32bad1be6bb9 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:25.692477 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ed6224c9-8733-4a05-a166-8255550421ce req-6dc93508-3945-466e-b505-32bad1be6bb9 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0482488 Dec 09 14:43:25.740368 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ed6224c9-8733-4a05-a166-8255550421ce req-c00e61fd-7c02-406b-997d-8de9f0a6c16c tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417736 Dec 09 14:43:26.173399 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-584926b8-8682-4e9a-9a3f-8803f8adb513 req-b37b4537-fd7b-4507-970c-a33bb3af61c7 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 210 time: 0.0256855 Dec 09 14:43:26.362913 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b676a870-e5fe-4c3a-92c5-67ea678f63bb req-0a76890d-57c1-41f9-b4fa-bcb3489a96f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:26.364895 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b676a870-e5fe-4c3a-92c5-67ea678f63bb req-0a76890d-57c1-41f9-b4fa-bcb3489a96f0 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=3d298e3ebec54c2281ddf8bbb50b7cea&device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 1098 time: 0.0420632 Dec 09 14:43:26.436170 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:43:26.500981 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1be1416-ea88-43ce-85fe-087c305a4502 req-7e73ed02-53ad-440e-b416-09d6e0e7cbf9 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:26.502432 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d1be1416-ea88-43ce-85fe-087c305a4502 req-7e73ed02-53ad-440e-b416-09d6e0e7cbf9 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0796185 Dec 09 14:43:26.503384 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b676a870-e5fe-4c3a-92c5-67ea678f63bb req-4cf84f84-ddd3-4073-a70c-5adbc8ac58b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:26.504714 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b676a870-e5fe-4c3a-92c5-67ea678f63bb req-4cf84f84-ddd3-4073-a70c-5adbc8ac58b9 service neutron] 10.222.0.44 "GET /v2.0/networks?id=8ff38a1e-5122-4806-8b7d-d4c281cbe550 HTTP/1.1" status: 200 len: 919 time: 0.1292682 Dec 09 14:43:26.552241 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d1be1416-ea88-43ce-85fe-087c305a4502 req-96d16378-29d5-4268-8d20-7ba1e83c16c7 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436640 Dec 09 14:43:26.883953 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce20e73a-8489-4b4c-874b-b7c58a03716a req-d73673d2-8375-45fc-a918-ecb4810b639c tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:26.886403 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ce20e73a-8489-4b4c-874b-b7c58a03716a req-d73673d2-8375-45fc-a918-ecb4810b639c tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0571251 Dec 09 14:43:26.932834 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ce20e73a-8489-4b4c-874b-b7c58a03716a req-e18a6c66-5647-41ec-b7c5-622823b19e08 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415387 Dec 09 14:43:26.985954 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4df27f9d-ecbc-4a8a-b71c-d793a4bfeb2b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:27.264701 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-aea65205-7979-4bc8-9354-5f5f930d01b8 req-253a5760-2315-4660-b207-98d1f2456014 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 210 time: 0.0252330 Dec 09 14:43:27.566623 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b676a870-e5fe-4c3a-92c5-67ea678f63bb req-dbb92548-78aa-4440-8790-0713ed20e643 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 HTTP/1.1" status: 200 len: 217 time: 0.0376272 Dec 09 14:43:27.675172 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60d6ae4b-3cb8-4944-b0fe-a5379c97e6b4 req-c85cac51-e4ed-4063-9636-4e960f7e23c7 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:27.676716 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-60d6ae4b-3cb8-4944-b0fe-a5379c97e6b4 req-c85cac51-e4ed-4063-9636-4e960f7e23c7 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0497379 Dec 09 14:43:27.729116 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-60d6ae4b-3cb8-4944-b0fe-a5379c97e6b4 req-2739cb15-da65-4754-8144-b401606b71a9 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461912 Dec 09 14:43:28.062062 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ec8f516-eb84-4cff-8407-8e713857b700 req-613664ba-159e-49f7-a11f-c2acda4ef57d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:28.063510 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7ec8f516-eb84-4cff-8407-8e713857b700 req-613664ba-159e-49f7-a11f-c2acda4ef57d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0496728 Dec 09 14:43:28.112098 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7ec8f516-eb84-4cff-8407-8e713857b700 req-e138091c-f3fc-48c4-b089-7b65f6a43b5c tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426507 Dec 09 14:43:28.376564 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a3f2efd8-6765-4c7f-9423-68765ee462e2 req-e82f0755-055f-4e96-af84-c534b15ad66e tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 210 time: 0.0280905 Dec 09 14:43:28.842068 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9dc0b44-eba5-4052-ba43-c73dd46c1bf6 req-55b34b4e-cb20-4191-9a3b-5597714e5128 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:28.843513 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a9dc0b44-eba5-4052-ba43-c73dd46c1bf6 req-55b34b4e-cb20-4191-9a3b-5597714e5128 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0485115 Dec 09 14:43:28.899824 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a9dc0b44-eba5-4052-ba43-c73dd46c1bf6 req-e0df9617-b109-4a30-ae3a-191f8a7560b1 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482430 Dec 09 14:43:29.173207 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-33016964-5b58-4a84-8eab-fd2dc35843e8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:29.238363 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abd68a50-ae13-454e-9d83-b0850d8a51c4 req-4eabf4a0-7828-4aab-921d-ddf774037e58 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:29.239885 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-abd68a50-ae13-454e-9d83-b0850d8a51c4 req-4eabf4a0-7828-4aab-921d-ddf774037e58 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0486190 Dec 09 14:43:29.288007 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-abd68a50-ae13-454e-9d83-b0850d8a51c4 req-f2458bc8-71d0-4c83-afd5-4aaca3c482a6 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417013 Dec 09 14:43:29.481578 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5dc722fc-d5ea-47f3-a2cb-f36d5ec2369d req-b1bad0e4-220b-4380-bed4-370f4a7a1aff tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 210 time: 0.0262868 Dec 09 14:43:29.572557 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b676a870-e5fe-4c3a-92c5-67ea678f63bb req-2869aa83-444d-4f32-97fe-646026ec46c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:29.574176 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b676a870-e5fe-4c3a-92c5-67ea678f63bb req-2869aa83-444d-4f32-97fe-646026ec46c7 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=90388423-2d07-4cbe-80d8-fa2f6a3c14f7 HTTP/1.1" status: 200 len: 858 time: 0.0495124 Dec 09 14:43:29.637125 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b676a870-e5fe-4c3a-92c5-67ea678f63bb req-48d34b07-6ff5-43a1-8728-3022ed15bf59 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=8ff38a1e-5122-4806-8b7d-d4c281cbe550&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0314896 Dec 09 14:43:29.735381 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b676a870-e5fe-4c3a-92c5-67ea678f63bb req-61e7952f-5add-41f6-b292-c3425e7739f5 service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0878208 Dec 09 14:43:29.839426 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b676a870-e5fe-4c3a-92c5-67ea678f63bb req-0e248e2b-6c1d-4b1e-91c6-261151408057 service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889585 Dec 09 14:43:30.015745 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c0d3ef2-04a2-457b-aa02-c5c499a40fc9 req-c600574a-db33-4bdc-aa90-01d41ddc5bd3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:30.017227 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2c0d3ef2-04a2-457b-aa02-c5c499a40fc9 req-c600574a-db33-4bdc-aa90-01d41ddc5bd3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0490074 Dec 09 14:43:30.315646 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2c0d3ef2-04a2-457b-aa02-c5c499a40fc9 req-aa7472b3-6265-4808-bcf4-3a41f660aa08 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2901495 Dec 09 14:43:30.352589 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15057151-3dae-44ac-87a4-b94dfe97331d req-e096524d-5f66-4196-9a9d-d734e7d42241 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:30.354045 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-15057151-3dae-44ac-87a4-b94dfe97331d req-e096524d-5f66-4196-9a9d-d734e7d42241 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "GET /v2.0/networks?id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d HTTP/1.1" status: 200 len: 815 time: 0.3267958 Dec 09 14:43:30.377916 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-15057151-3dae-44ac-87a4-b94dfe97331d req-b8ec58bf-c4a5-4e6c-9121-830072ebab58 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Request body: {'port': {'device_id': '84fcfcdd-cc22-49d3-aa97-428cb9a1c56a', 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d', 'admin_state_up': True, 'tenant_id': '5ec989b7fd3e45f2b8962e012b0797ac'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:30.404718 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:30.433218 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7eb8d0b-22a9-46ac-a995-2f3df0b8ba04 req-77fa79ce-a4da-4d41-9898-402fb32734a3 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:30.434742 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f7eb8d0b-22a9-46ac-a995-2f3df0b8ba04 req-77fa79ce-a4da-4d41-9898-402fb32734a3 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0753229 Dec 09 14:43:30.495906 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f7eb8d0b-22a9-46ac-a995-2f3df0b8ba04 req-7ec264cd-4df0-455f-bfb2-e9908eae10db tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0550380 Dec 09 14:43:30.524949 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-15057151-3dae-44ac-87a4-b94dfe97331d req-b8ec58bf-c4a5-4e6c-9121-830072ebab58 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Made reservation on behalf of 5ec989b7fd3e45f2b8962e012b0797ac for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:43:30.529869 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-15057151-3dae-44ac-87a4-b94dfe97331d req-b8ec58bf-c4a5-4e6c-9121-830072ebab58 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:30.645814 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-95f4fd8b-41cd-499e-b8b6-76007b078341 req-72d27b80-8d8b-4e01-9865-34bb237abb3d tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 210 time: 0.0568442 Dec 09 14:43:30.741760 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-15057151-3dae-44ac-87a4-b94dfe97331d req-b8ec58bf-c4a5-4e6c-9121-830072ebab58 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Allocated IP 172.20.0.5 (99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d/7c6b4bb0-bfec-44d0-8503-70917540b3c5/e559e9a2-7a62-4c44-83c1-bed1dc8d99e6) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:43:30.941736 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-15057151-3dae-44ac-87a4-b94dfe97331d req-b8ec58bf-c4a5-4e6c-9121-830072ebab58 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:30.980817 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-15057151-3dae-44ac-87a4-b94dfe97331d req-b8ec58bf-c4a5-4e6c-9121-830072ebab58 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:30.995764 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['746ea6aa-be43-4fbf-9463-02d741db305a'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:43:31.023905 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-15057151-3dae-44ac-87a4-b94dfe97331d req-b8ec58bf-c4a5-4e6c-9121-830072ebab58 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:43:31.029322 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-15057151-3dae-44ac-87a4-b94dfe97331d req-b8ec58bf-c4a5-4e6c-9121-830072ebab58 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:43:31.033132 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-15057151-3dae-44ac-87a4-b94dfe97331d req-b8ec58bf-c4a5-4e6c-9121-830072ebab58 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:43:31.039890 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8ec58bf-c4a5-4e6c-9121-830072ebab58 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Pushing event updated for resources: {'Port': ['ID=e559e9a2-7a62-4c44-83c1-bed1dc8d99e6,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:31.092637 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15057151-3dae-44ac-87a4-b94dfe97331d req-b8ec58bf-c4a5-4e6c-9121-830072ebab58 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:31.093293 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-15057151-3dae-44ac-87a4-b94dfe97331d req-b8ec58bf-c4a5-4e6c-9121-830072ebab58 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:31.116516 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-15057151-3dae-44ac-87a4-b94dfe97331d req-b8ec58bf-c4a5-4e6c-9121-830072ebab58 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7425556 Dec 09 14:43:31.136989 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Request body: {'port': {'device_id': '84fcfcdd-cc22-49d3-aa97-428cb9a1c56a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:31.195324 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:31.483772 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-530f8fd9-d5d9-4af4-ad21-ca9f976f4a82 req-60604c51-e5d0-4308-b869-01f1040e1c37 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:31.485281 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-530f8fd9-d5d9-4af4-ad21-ca9f976f4a82 req-60604c51-e5d0-4308-b869-01f1040e1c37 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0933690 Dec 09 14:43:31.499059 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:43:31.511264 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:31.537734 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Transition to ACTIVE for port object e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:43:31.544065 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:31.592417 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-530f8fd9-d5d9-4af4-ad21-ca9f976f4a82 req-20ef8862-153f-4e03-837c-b12e7df0b239 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0975487 Dec 09 14:43:31.611425 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Pushing event updated for resources: {'Port': ['ID=e559e9a2-7a62-4c44-83c1-bed1dc8d99e6,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:31.643701 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-222beb70-8890-470a-abd7-bd441b59a160 req-8817711e-a1cf-479d-99c5-b291f2eb7652 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:31.645169 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-222beb70-8890-470a-abd7-bd441b59a160 req-8817711e-a1cf-479d-99c5-b291f2eb7652 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0641940 Dec 09 14:43:31.679505 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Attempting to bind port e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:43:31.679841 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Attempting to bind port e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:43:31.680503 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Attempting to bind port e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 on network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:43:31.685242 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Port e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 on network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:43:31.685578 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Attempting to bind port e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 on network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:43:31.690901 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 43, 14), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:43:31.691246 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Checking segment: {'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:43:31.691659 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Bound using segment: {'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:43:31.692110 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Bound port: e559e9a2-7a62-4c44-83c1-bed1dc8d99e6, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:43:31.692483 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:31.696492 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-222beb70-8890-470a-abd7-bd441b59a160 req-03e66378-dc47-4b0a-8a71-5d870ee2b607 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451744 Dec 09 14:43:31.770271 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] For port e559e9a2-7a62-4c44-83c1-bed1dc8d99e6, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:43:31.776123 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] For port e559e9a2-7a62-4c44-83c1-bed1dc8d99e6, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=e559e9a2-7a62-4c44-83c1-bed1dc8d99e6,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:43:31.781953 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:31.791940 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:31.810737 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-276a9a2a-e7df-4e14-9119-643fd6a6aa23 req-0ae754e5-7905-405c-88be-d511b4daf2f9 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:31.813141 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-276a9a2a-e7df-4e14-9119-643fd6a6aa23 req-0ae754e5-7905-405c-88be-d511b4daf2f9 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 943 time: 0.0533400 Dec 09 14:43:31.821648 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:31.822188 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:31.823596 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] 10.222.0.44 "PUT /v2.0/ports/e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 HTTP/1.1" status: 200 len: 1093 time: 0.6912069 Dec 09 14:43:31.824082 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '84fcfcdd-cc22-49d3-aa97-428cb9a1c56a', 'tag': 'e559e9a2-7a62-4c44-83c1-bed1dc8d99e6'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:31.826386 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-63a49de8-0dc2-4148-900b-feda7411956c" -d '{"events": [{"name": "network-changed", "server_uuid": "84fcfcdd-cc22-49d3-aa97-428cb9a1c56a", "tag": "e559e9a2-7a62-4c44-83c1-bed1dc8d99e6"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:31.850067 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4047b861-7f4b-4b15-8fba-3090ea89688e service neutron] Pushing event updated for resources: {'Port': ['ID=e559e9a2-7a62-4c44-83c1-bed1dc8d99e6,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:31.880847 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-276a9a2a-e7df-4e14-9119-643fd6a6aa23 req-760a1e80-5c20-4984-b954-80cfb5d76813 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0595331 Dec 09 14:43:31.930300 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29098fbc-0fff-4493-8ee0-b60ec6a30876 req-013d0437-44a8-4313-8199-860cbd12fb6c tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:31.930300 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-29098fbc-0fff-4493-8ee0-b60ec6a30876 req-013d0437-44a8-4313-8199-860cbd12fb6c tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0809135 Dec 09 14:43:31.938352 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 53312) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:31.944153 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-c6de4f26-2d7d-455b-b57f-a4b4ddf06477 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Request body: {'floatingip': {'port_id': 'c5d8b8cc-2c67-46a7-867d-276136fccdf1'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:31.976963 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5dc32c0a-8856-4c00-9e30-4ac7d3e5665b x-openstack-request-id: req-5dc32c0a-8856-4c00-9e30-4ac7d3e5665b {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:31.977263 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "84fcfcdd-cc22-49d3-aa97-428cb9a1c56a", "tag": "e559e9a2-7a62-4c44-83c1-bed1dc8d99e6", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:31.977504 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-5dc32c0a-8856-4c00-9e30-4ac7d3e5665b {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:31.977913 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '84fcfcdd-cc22-49d3-aa97-428cb9a1c56a', 'tag': 'e559e9a2-7a62-4c44-83c1-bed1dc8d99e6', 'status': 'completed', 'code': 200} Dec 09 14:43:32.024384 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c6de4f26-2d7d-455b-b57f-a4b4ddf06477 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for floatingip, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:32.027746 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15057151-3dae-44ac-87a4-b94dfe97331d req-d1ebc1bf-1c35-4070-8b74-e229823d2db2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:32.029166 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-15057151-3dae-44ac-87a4-b94dfe97331d req-d1ebc1bf-1c35-4070-8b74-e229823d2db2 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=5ec989b7fd3e45f2b8962e012b0797ac&device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 1096 time: 0.1403522 Dec 09 14:43:32.135255 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-15057151-3dae-44ac-87a4-b94dfe97331d req-fc1c5ccb-fef1-40c0-8985-af4f1df20de7 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 HTTP/1.1" status: 200 len: 217 time: 0.0731671 Dec 09 14:43:32.239951 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15057151-3dae-44ac-87a4-b94dfe97331d req-fff78233-40c5-4b3e-a2c9-e5bfe1d5cb7b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:32.241531 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-15057151-3dae-44ac-87a4-b94dfe97331d req-fff78233-40c5-4b3e-a2c9-e5bfe1d5cb7b service neutron] 10.222.0.44 "GET /v2.0/subnets?id=7c6b4bb0-bfec-44d0-8503-70917540b3c5 HTTP/1.1" status: 200 len: 855 time: 0.0923502 Dec 09 14:43:32.305514 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-15057151-3dae-44ac-87a4-b94dfe97331d req-4ee49439-f6b8-4e1d-b273-dd0ba8a500b4 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0309207 Dec 09 14:43:32.550730 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-15057151-3dae-44ac-87a4-b94dfe97331d req-2cd11141-8157-4cdc-bf4d-d2633ab2254a service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2324243 Dec 09 14:43:32.628637 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:33.006879 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-186886c5-1169-4c94-8797-157eb72d0a02 req-5dd29c6e-49b5-4908-b87b-ddb4405c66a6 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:33.008692 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-186886c5-1169-4c94-8797-157eb72d0a02 req-5dd29c6e-49b5-4908-b87b-ddb4405c66a6 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 943 time: 0.0530663 Dec 09 14:43:33.060942 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-186886c5-1169-4c94-8797-157eb72d0a02 req-3abc25e2-6aa8-45ca-bac3-e02f65d76dc3 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442095 Dec 09 14:43:33.063303 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6610157e-d017-4f45-bbaa-fc807ce48df0 req-c56b38ae-77bf-423a-a460-2f42117e58d5 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:33.064895 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6610157e-d017-4f45-bbaa-fc807ce48df0 req-c56b38ae-77bf-423a-a460-2f42117e58d5 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.3857498 Dec 09 14:43:33.066730 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-15057151-3dae-44ac-87a4-b94dfe97331d req-3c788429-7a29-455d-97cc-356637c084e0 service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4974964 Dec 09 14:43:33.090854 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.db.resource_extend [None req-c6de4f26-2d7d-455b-b57f-a4b4ddf06477 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] It took 0.31 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Dec 09 14:43:33.210444 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c6de4f26-2d7d-455b-b57f-a4b4ddf06477 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:33.219908 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c6de4f26-2d7d-455b-b57f-a4b4ddf06477 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:33.228759 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6610157e-d017-4f45-bbaa-fc807ce48df0 req-2a3b5768-feab-418f-b637-f91efacb2ea1 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1559772 Dec 09 14:43:33.273631 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63a49de8-0dc2-4148-900b-feda7411956c req-3b767e79-5de3-4cf7-8121-5524775d23ec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:33.275155 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-63a49de8-0dc2-4148-900b-feda7411956c req-3b767e79-5de3-4cf7-8121-5524775d23ec service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=5ec989b7fd3e45f2b8962e012b0797ac&device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 1096 time: 0.1414309 Dec 09 14:43:33.388591 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.l3_db [None req-c6de4f26-2d7d-455b-b57f-a4b4ddf06477 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Floating IP 4d08e902-ab2c-438b-a206-5afe09074fbe associated. External IP: 172.27.0.16, port: c5d8b8cc-2c67-46a7-867d-276136fccdf1. Dec 09 14:43:33.457086 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63a49de8-0dc2-4148-900b-feda7411956c req-b9d43ef5-34fb-4c4a-b5cf-b8d6568ed41a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:33.458602 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-63a49de8-0dc2-4148-900b-feda7411956c req-b9d43ef5-34fb-4c4a-b5cf-b8d6568ed41a service neutron] 10.222.0.44 "GET /v2.0/networks?id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d HTTP/1.1" status: 200 len: 916 time: 0.1462216 Dec 09 14:43:33.524031 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-63a49de8-0dc2-4148-900b-feda7411956c req-79622600-8747-451e-90a0-b846a125b849 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 HTTP/1.1" status: 200 len: 217 time: 0.0370359 Dec 09 14:43:33.621080 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63a49de8-0dc2-4148-900b-feda7411956c req-7f681ddf-40f3-4a8d-bd18-7bede4142bb4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:33.622575 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-63a49de8-0dc2-4148-900b-feda7411956c req-7f681ddf-40f3-4a8d-bd18-7bede4142bb4 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=7c6b4bb0-bfec-44d0-8503-70917540b3c5 HTTP/1.1" status: 200 len: 855 time: 0.0854187 Dec 09 14:43:33.683407 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-63a49de8-0dc2-4148-900b-feda7411956c req-c125d99b-1946-494a-80a2-f4f3786238be service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0507078 Dec 09 14:43:33.758649 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c6de4f26-2d7d-455b-b57f-a4b4ddf06477 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Router 55e9791c-df4d-4622-ba5c-87f71cd3c12b has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:43:33.849160 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-63a49de8-0dc2-4148-900b-feda7411956c req-4c118452-6ebf-4996-9edd-d5203511d0f9 service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1514466 Dec 09 14:43:33.949482 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c6de4f26-2d7d-455b-b57f-a4b4ddf06477 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:43:33.954947 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c6de4f26-2d7d-455b-b57f-a4b4ddf06477 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:33.960232 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2328b837-8fec-4f37-8f86-0cff4eb1d3f6 None None] Sync routers for ids ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:43:33.973169 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2328b837-8fec-4f37-8f86-0cff4eb1d3f6 None None] Routers {'55e9791c-df4d-4622-ba5c-87f71cd3c12b'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:43:33.973765 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-2328b837-8fec-4f37-8f86-0cff4eb1d3f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:43:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:33.999890 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-c6de4f26-2d7d-455b-b57f-a4b4ddf06477 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "PUT /v2.0/floatingips/4d08e902-ab2c-438b-a206-5afe09074fbe HTTP/1.1" status: 200 len: 990 time: 2.0598302 Dec 09 14:43:34.002036 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '31f6f258-99da-4d63-b6dd-0b20015bf98e', 'tag': 'c5d8b8cc-2c67-46a7-867d-276136fccdf1'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:34.004638 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ebb190e2-3945-4d10-b758-3a3811641259" -d '{"events": [{"name": "network-changed", "server_uuid": "31f6f258-99da-4d63-b6dd-0b20015bf98e", "tag": "c5d8b8cc-2c67-46a7-867d-276136fccdf1"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:34.009883 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-63a49de8-0dc2-4148-900b-feda7411956c req-284a2ded-6c7d-48e5-9043-eda0887b008c service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1352692 Dec 09 14:43:34.088270 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-2328b837-8fec-4f37-8f86-0cff4eb1d3f6 None None] Set router 55e9791c-df4d-4622-ba5c-87f71cd3c12b gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:43:34.089639 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5625524d-4cf3-4493-a303-1d0d8675a01d x-openstack-request-id: req-5625524d-4cf3-4493-a303-1d0d8675a01d {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:34.090563 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "31f6f258-99da-4d63-b6dd-0b20015bf98e", "tag": "c5d8b8cc-2c67-46a7-867d-276136fccdf1", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:34.090885 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-5625524d-4cf3-4493-a303-1d0d8675a01d {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:34.091377 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '31f6f258-99da-4d63-b6dd-0b20015bf98e', 'tag': 'c5d8b8cc-2c67-46a7-867d-276136fccdf1', 'status': 'completed', 'code': 200} Dec 09 14:43:34.182763 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e8246c-3b45-4a90-bf1b-8d2ece6b2dd5 req-70c9c829-76cb-4c12-9a13-a73a8afe06d2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:34.184269 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-68e8246c-3b45-4a90-bf1b-8d2ece6b2dd5 req-70c9c829-76cb-4c12-9a13-a73a8afe06d2 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 943 time: 0.0476611 Dec 09 14:43:34.185570 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebb190e2-3945-4d10-b758-3a3811641259 req-853df8a9-6e1b-4f5c-8a69-5ab6d0872788 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:34.187360 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ebb190e2-3945-4d10-b758-3a3811641259 req-853df8a9-6e1b-4f5c-8a69-5ab6d0872788 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=a538bf01cb5440ffa06b6873f212efaa&device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 1098 time: 0.0421522 Dec 09 14:43:34.231234 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-68e8246c-3b45-4a90-bf1b-8d2ece6b2dd5 req-a75c7b96-5989-4463-afee-87ed97210957 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407932 Dec 09 14:43:34.286634 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebb190e2-3945-4d10-b758-3a3811641259 req-8207ef3b-6a4b-40f4-9dd6-a37d5d572617 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:34.288185 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ebb190e2-3945-4d10-b758-3a3811641259 req-8207ef3b-6a4b-40f4-9dd6-a37d5d572617 service neutron] 10.222.0.44 "GET /v2.0/networks?id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b HTTP/1.1" status: 200 len: 911 time: 0.0888610 Dec 09 14:43:34.315865 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-2328b837-8fec-4f37-8f86-0cff4eb1d3f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '4d08e902-ab2c-438b-a206-5afe09074fbe', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'floating_ip_address': '172.27.0.16', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'port_id': 'c5d8b8cc-2c67-46a7-867d-276136fccdf1', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 145, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'mac_address': 'fa:16:3e:5b:b5:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31f6f258-99da-4d63-b6dd-0b20015bf98e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:43:02Z', 'updated_at': '2021-12-09T14:43:32Z', 'revision_number': 1, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ade23a8f-bc90-4df9-9f92-95d4b4587037', 'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'mac_address': 'fa:16:3e:65:b3:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 124, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:58Z', 'revision_number': 5, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'subnets': [{'id': '4b7e026c-4454-4200-91c3-30d27a976452', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:34.395103 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ebb190e2-3945-4d10-b758-3a3811641259 req-6c91f4a6-da1b-4262-9b61-edbdd85a808b service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c5d8b8cc-2c67-46a7-867d-276136fccdf1 HTTP/1.1" status: 200 len: 998 time: 0.0901852 Dec 09 14:43:34.408714 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47060a4a-1181-4b3e-9b2f-76c7af520f1a req-e321a457-fc42-4477-960b-57828955b465 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:34.410974 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-47060a4a-1181-4b3e-9b2f-76c7af520f1a req-e321a457-fc42-4477-960b-57828955b465 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0975440 Dec 09 14:43:34.427216 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2328b837-8fec-4f37-8f86-0cff4eb1d3f6 None None] Checking router: 55e9791c-df4d-4622-ba5c-87f71cd3c12b for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:43:34.435945 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2328b837-8fec-4f37-8f86-0cff4eb1d3f6 None None] Routers {'55e9791c-df4d-4622-ba5c-87f71cd3c12b'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:43:34.436477 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-2328b837-8fec-4f37-8f86-0cff4eb1d3f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:43:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:34.484160 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebb190e2-3945-4d10-b758-3a3811641259 req-9d4d1b91-5523-4c00-b7b3-cdc2fff68a77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:34.485648 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ebb190e2-3945-4d10-b758-3a3811641259 req-9d4d1b91-5523-4c00-b7b3-cdc2fff68a77 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=4b7e026c-4454-4200-91c3-30d27a976452 HTTP/1.1" status: 200 len: 849 time: 0.0736606 Dec 09 14:43:34.497888 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-47060a4a-1181-4b3e-9b2f-76c7af520f1a req-af48adb5-ecd7-4191-a93e-6b67f5ca9d05 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0776141 Dec 09 14:43:34.554040 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-2328b837-8fec-4f37-8f86-0cff4eb1d3f6 None None] Set router 55e9791c-df4d-4622-ba5c-87f71cd3c12b gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:43:34.564247 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebb190e2-3945-4d10-b758-3a3811641259 req-876124dc-0ac3-47e1-8ae6-00d4574c9390 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:34.566300 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ebb190e2-3945-4d10-b758-3a3811641259 req-876124dc-0ac3-47e1-8ae6-00d4574c9390 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0621531 Dec 09 14:43:34.671397 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ebb190e2-3945-4d10-b758-3a3811641259 req-802b795a-ae1c-44b9-acd8-25d990dbae99 service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0963771 Dec 09 14:43:34.778618 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ebb190e2-3945-4d10-b758-3a3811641259 req-78ce38a0-4e17-4268-a7b3-2ba8b87dcfbe service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0939372 Dec 09 14:43:34.801287 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-2328b837-8fec-4f37-8f86-0cff4eb1d3f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '4d08e902-ab2c-438b-a206-5afe09074fbe', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'floating_ip_address': '172.27.0.16', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'port_id': 'c5d8b8cc-2c67-46a7-867d-276136fccdf1', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 145, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'mac_address': 'fa:16:3e:5b:b5:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31f6f258-99da-4d63-b6dd-0b20015bf98e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:43:02Z', 'updated_at': '2021-12-09T14:43:32Z', 'revision_number': 1, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ade23a8f-bc90-4df9-9f92-95d4b4587037', 'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'mac_address': 'fa:16:3e:65:b3:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 124, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:58Z', 'revision_number': 5, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'subnets': [{'id': '4b7e026c-4454-4200-91c3-30d27a976452', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:34.830761 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2328b837-8fec-4f37-8f86-0cff4eb1d3f6 None None] The sync data for ids ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'] in dv-cinder-819692-8-iscsi is: [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '4d08e902-ab2c-438b-a206-5afe09074fbe', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'floating_ip_address': '172.27.0.16', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'port_id': 'c5d8b8cc-2c67-46a7-867d-276136fccdf1', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 145, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'mac_address': 'fa:16:3e:5b:b5:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '31f6f258-99da-4d63-b6dd-0b20015bf98e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:43:02Z', 'updated_at': '2021-12-09T14:43:32Z', 'revision_number': 1, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ade23a8f-bc90-4df9-9f92-95d4b4587037', 'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'mac_address': 'fa:16:3e:65:b3:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 124, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:58Z', 'revision_number': 5, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'subnets': [{'id': '4b7e026c-4454-4200-91c3-30d27a976452', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:43:35.032248 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 53432) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:35.041912 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9dba7480-015c-4207-8928-fbaaf9e0a27f None None] New status for floating IP 4d08e902-ab2c-438b-a206-5afe09074fbe: ACTIVE {{(pid=109063) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:43:35.240750 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:35.322115 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:35.326575 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:35.359865 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc71af95-0b3e-48a1-9e1b-8f6bf5cff7f6 req-89e09514-1a66-42d1-a058-f4270a6ce83d tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:35.361352 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-bc71af95-0b3e-48a1-9e1b-8f6bf5cff7f6 req-89e09514-1a66-42d1-a058-f4270a6ce83d tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 943 time: 0.0500610 Dec 09 14:43:35.362588 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7bd37d93-f29f-4cb4-97bd-aa03119121a6,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:35.368166 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=fc4a74c4301142138e97f5ff725d35bc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3339770 Dec 09 14:43:35.370122 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 53452) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:35.373184 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.373542 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.373890 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.374233 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.374568 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.374897 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.375225 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.375554 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.375919 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.376228 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.376554 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.376873 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.377193 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ec259a72-9666-40d6-b676-8a2449a46d97 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.444138 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-bc71af95-0b3e-48a1-9e1b-8f6bf5cff7f6 req-c8aee564-41c1-4fd3-9952-7eb4fd2b2af7 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0760558 Dec 09 14:43:35.449036 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:35.470961 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:35.520350 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:35.523107 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:35.524462 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/7bd37d93-f29f-4cb4-97bd-aa03119121a6 HTTP/1.1" status: 204 len: 168 time: 0.1484725 Dec 09 14:43:35.532248 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7bd37d93-f29f-4cb4-97bd-aa03119121a6,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:35.539472 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.539852 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.540201 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.540545 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.540879 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.541206 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.541535 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.541869 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.542200 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.542550 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.542888 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.543356 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.543585 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-204b8a7d-c6bd-42e1-add6-9ce95c0151d3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:35.626858 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5462f2c6-92b5-43a9-a905-0a6d67414d13 req-566f64a6-211e-4b36-8ac7-40b7780f2ab3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:35.629272 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5462f2c6-92b5-43a9-a905-0a6d67414d13 req-566f64a6-211e-4b36-8ac7-40b7780f2ab3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0553319 Dec 09 14:43:35.680896 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5462f2c6-92b5-43a9-a905-0a6d67414d13 req-29e99292-35e6-4d79-abbb-e59cc58469d1 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447588 Dec 09 14:43:35.822083 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 53470) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:35.834995 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8adc32b3-4983-4c2e-82b0-d3e2ec93c06a admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:35.908999 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8adc32b3-4983-4c2e-82b0-d3e2ec93c06a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:35.913346 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8adc32b3-4983-4c2e-82b0-d3e2ec93c06a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:35.955724 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-8adc32b3-4983-4c2e-82b0-d3e2ec93c06a admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=4ec676411a3e428ebbaf7fb6fd37e889&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1301947 Dec 09 14:43:35.955724 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8adc32b3-4983-4c2e-82b0-d3e2ec93c06a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dccc2600-b38a-47de-b3cc-25afa2c0fa4a,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:35.956127 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 53476) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:36.015180 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3fbc424a-24bc-4b3b-b919-31083a6fef90 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:36.036837 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3fbc424a-24bc-4b3b-b919-31083a6fef90 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:36.088378 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3fbc424a-24bc-4b3b-b919-31083a6fef90 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:36.090842 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3fbc424a-24bc-4b3b-b919-31083a6fef90 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:36.092040 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-3fbc424a-24bc-4b3b-b919-31083a6fef90 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/dccc2600-b38a-47de-b3cc-25afa2c0fa4a HTTP/1.1" status: 204 len: 168 time: 0.1342628 Dec 09 14:43:36.100216 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fbc424a-24bc-4b3b-b919-31083a6fef90 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dccc2600-b38a-47de-b3cc-25afa2c0fa4a,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:36.321216 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:43:36.438460 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port e559e9a2-7a62-4c44-83c1-bed1dc8d99e6, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=e559e9a2-7a62-4c44-83c1-bed1dc8d99e6,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:36.450987 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': 'e559e9a2-7a62-4c44-83c1-bed1dc8d99e6', 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d', 'port_id': 'e559e9a2-7a62-4c44-83c1-bed1dc8d99e6', 'mac_address': 'fa:16:3e:11:26:ec', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 405, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7c6b4bb0-bfec-44d0-8503-70917540b3c5', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:43:36.481741 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 53508) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:36.492292 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:36.497163 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e343f48a-afbc-4503-8733-74b966d22aef admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:36.596743 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0bb879d-1ccf-467b-aa8d-61ac6c4c4e64 req-8c41fa19-d156-4eb2-9c6a-bc2f13cf4ff9 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:36.598270 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e0bb879d-1ccf-467b-aa8d-61ac6c4c4e64 req-8c41fa19-d156-4eb2-9c6a-bc2f13cf4ff9 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 943 time: 0.0756454 Dec 09 14:43:36.624305 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:43:36.633171 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e343f48a-afbc-4503-8733-74b966d22aef admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:36.639267 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e343f48a-afbc-4503-8733-74b966d22aef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:36.644500 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port e559e9a2-7a62-4c44-83c1-bed1dc8d99e6, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=e559e9a2-7a62-4c44-83c1-bed1dc8d99e6,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:36.649204 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:36.679889 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-e343f48a-afbc-4503-8733-74b966d22aef admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=fe1802769798409aa543e8471b8d920e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1967742 Dec 09 14:43:36.682779 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 53510) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:36.695310 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e0bb879d-1ccf-467b-aa8d-61ac6c4c4e64 req-26b78ec1-9fcd-4944-8d11-c1be7a75a457 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0870235 Dec 09 14:43:36.696947 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e343f48a-afbc-4503-8733-74b966d22aef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07135d5f-13f2-4918-ac0e-5e3cae59ebba,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:36.713508 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=e559e9a2-7a62-4c44-83c1-bed1dc8d99e6,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:36.723276 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:36.723679 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:36.724091 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:36.724379 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:36.724769 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:36.725105 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:36.725438 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:36.725768 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:36.726286 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:36.726897 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:36.727228 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:36.727560 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:36.728227 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:36.733814 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-60afef68-c4d1-4fa0-8c55-ed8ebd05f0f1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:36.756187 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-60afef68-c4d1-4fa0-8c55-ed8ebd05f0f1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:36.832908 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-809ddd3a-37fb-4d2a-be75-30cc9700f1fb req-0b3174c2-5800-488b-9087-bb105c65ca9d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:36.834387 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-809ddd3a-37fb-4d2a-be75-30cc9700f1fb req-0b3174c2-5800-488b-9087-bb105c65ca9d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0709112 Dec 09 14:43:36.849333 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-60afef68-c4d1-4fa0-8c55-ed8ebd05f0f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:36.852017 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-60afef68-c4d1-4fa0-8c55-ed8ebd05f0f1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:36.853099 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-60afef68-c4d1-4fa0-8c55-ed8ebd05f0f1 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/07135d5f-13f2-4918-ac0e-5e3cae59ebba HTTP/1.1" status: 204 len: 168 time: 0.1692724 Dec 09 14:43:36.872086 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60afef68-c4d1-4fa0-8c55-ed8ebd05f0f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07135d5f-13f2-4918-ac0e-5e3cae59ebba,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:36.901064 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-809ddd3a-37fb-4d2a-be75-30cc9700f1fb req-ead2d9e7-07d3-4a1d-be09-4b7c6d6826b3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0601768 Dec 09 14:43:37.290155 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 53538) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:37.338904 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_v2 [None req-d7376b1d-da51-4df8-8576-1d219582cca7 admin admin] Deleting subnet 9c9610d7-432c-4800-81dd-563520bc1c74 {{(pid=109062) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:43:37.342923 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d7376b1d-da51-4df8-8576-1d219582cca7 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:37.381255 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d7376b1d-da51-4df8-8576-1d219582cca7 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-130415749'] for subnet, precommit_delete_associations {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:37.419416 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d7376b1d-da51-4df8-8576-1d219582cca7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:37.474504 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d7376b1d-da51-4df8-8576-1d219582cca7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-130461228', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-130768914'] for subnet, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:37.501409 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7376b1d-da51-4df8-8576-1d219582cca7 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9c9610d7-432c-4800-81dd-563520bc1c74,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:37.505415 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d7376b1d-da51-4df8-8576-1d219582cca7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:37.511505 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 53554) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:37.514450 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-d7376b1d-da51-4df8-8576-1d219582cca7 admin admin] 10.222.0.39 "DELETE /v2.0/subnets/9c9610d7-432c-4800-81dd-563520bc1c74 HTTP/1.1" status: 204 len: 168 time: 0.2231741 Dec 09 14:43:37.587509 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2f77da71-4370-409d-be24-b5665506b5d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:37.669228 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2f77da71-4370-409d-be24-b5665506b5d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:37.689546 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-2f77da71-4370-409d-be24-b5665506b5d3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7c89e0f7-1db1-4696-bb02-eab2b42330b3']}} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:37.700182 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-2f77da71-4370-409d-be24-b5665506b5d3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f73b720a-604f-46ed-aa6c-972d78566733') {'for_net_delete': True} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:37.700461 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-2f77da71-4370-409d-be24-b5665506b5d3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f73b720a-604f-46ed-aa6c-972d78566733') {} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:37.710160 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2f77da71-4370-409d-be24-b5665506b5d3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1271949'] for segment, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:37.724345 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2f77da71-4370-409d-be24-b5665506b5d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:37.731479 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2f77da71-4370-409d-be24-b5665506b5d3 admin admin] Releasing vlan 410 on physical network physnet1 to pool {{(pid=109061) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:43:37.731960 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2f77da71-4370-409d-be24-b5665506b5d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-133412129'] for segment, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: Traceback (most recent call last): Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: timer() Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: cb(*args, **kw) Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: return func(*args, **kwargs) Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: self._notify() Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: self.callback(batched_events) Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: event.method(event) Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: return f(self, *a, **k) Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._get(url).json() Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: return self.request(url, 'GET', **kwargs) Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:43:37.733782 dv-cinder-819692-8-iscsi neutron-server[109061]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:43:37.798019 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2f77da71-4370-409d-be24-b5665506b5d3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:37.805869 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2f77da71-4370-409d-be24-b5665506b5d3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:37.809286 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-2f77da71-4370-409d-be24-b5665506b5d3 admin admin] 10.222.0.39 "DELETE /v2.0/networks/7c89e0f7-1db1-4696-bb02-eab2b42330b3 HTTP/1.1" status: 204 len: 168 time: 0.2966816 Dec 09 14:43:37.812025 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 53572) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:37.819191 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f77da71-4370-409d-be24-b5665506b5d3 admin admin] Pushing event deleted for resources: {'Network': ['ID=7c89e0f7-1db1-4696-bb02-eab2b42330b3,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:37.865130 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_v2 [None req-6a9a677f-e678-4583-a09f-c01a757db5d8 admin admin] Deleting subnet 5d42783b-3eca-442a-bfe6-fa256008fdf8 {{(pid=109062) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:43:37.868276 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6a9a677f-e678-4583-a09f-c01a757db5d8 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:37.902244 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6a9a677f-e678-4583-a09f-c01a757db5d8 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-130415749'] for subnet, precommit_delete_associations {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:37.942570 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6a9a677f-e678-4583-a09f-c01a757db5d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:37.998899 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6a9a677f-e678-4583-a09f-c01a757db5d8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-130461228', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-130768914'] for subnet, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:38.023277 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6a9a677f-e678-4583-a09f-c01a757db5d8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5d42783b-3eca-442a-bfe6-fa256008fdf8,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:38.027122 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6a9a677f-e678-4583-a09f-c01a757db5d8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:38.030402 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-6a9a677f-e678-4583-a09f-c01a757db5d8 admin admin] 10.222.0.39 "DELETE /v2.0/subnets/5d42783b-3eca-442a-bfe6-fa256008fdf8 HTTP/1.1" status: 204 len: 168 time: 0.2171323 Dec 09 14:43:38.033026 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 53580) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:38.103511 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cf7b2fc0-8a33-4ac2-8cb4-231bef02580e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:38.178243 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cf7b2fc0-8a33-4ac2-8cb4-231bef02580e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:38.197644 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-cf7b2fc0-8a33-4ac2-8cb4-231bef02580e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4ff9fb6e-1991-4952-8fc0-ebf53225fd28']}} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:38.206611 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-cf7b2fc0-8a33-4ac2-8cb4-231bef02580e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '8b94d131-b7a5-411f-b4ad-4b8360f12271') {'for_net_delete': True} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:38.206915 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-cf7b2fc0-8a33-4ac2-8cb4-231bef02580e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '8b94d131-b7a5-411f-b4ad-4b8360f12271') {} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:38.219970 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cf7b2fc0-8a33-4ac2-8cb4-231bef02580e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-130415758'] for segment, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:38.234224 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cf7b2fc0-8a33-4ac2-8cb4-231bef02580e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:38.240676 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cf7b2fc0-8a33-4ac2-8cb4-231bef02580e admin admin] Releasing vlan 443 on physical network physnet1 to pool {{(pid=109062) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:43:38.241051 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cf7b2fc0-8a33-4ac2-8cb4-231bef02580e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-130461398'] for segment, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: Traceback (most recent call last): Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: timer() Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: cb(*args, **kw) Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: return func(*args, **kwargs) Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: self._notify() Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: self.callback(batched_events) Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: event.method(event) Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: return f(self, *a, **k) Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._get(url).json() Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: return self.request(url, 'GET', **kwargs) Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:43:38.242715 dv-cinder-819692-8-iscsi neutron-server[109062]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:43:38.294527 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cf7b2fc0-8a33-4ac2-8cb4-231bef02580e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:38.299917 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cf7b2fc0-8a33-4ac2-8cb4-231bef02580e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:38.303019 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-cf7b2fc0-8a33-4ac2-8cb4-231bef02580e admin admin] 10.222.0.39 "DELETE /v2.0/networks/4ff9fb6e-1991-4952-8fc0-ebf53225fd28 HTTP/1.1" status: 204 len: 168 time: 0.2690260 Dec 09 14:43:38.313820 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf7b2fc0-8a33-4ac2-8cb4-231bef02580e admin admin] Pushing event deleted for resources: {'Network': ['ID=4ff9fb6e-1991-4952-8fc0-ebf53225fd28,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:38.479629 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 53586) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:38.527312 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-9c94859e-3868-4a03-9354-32895785f36a admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=21222e8023f9407d8236cc1fedf88c2a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0464222 Dec 09 14:43:38.529716 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 53590) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:38.573951 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-762cd4dd-15a7-46fc-8e12-38b41bf5cb8a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:38.594480 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-762cd4dd-15a7-46fc-8e12-38b41bf5cb8a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:38.841957 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-762cd4dd-15a7-46fc-8e12-38b41bf5cb8a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:38.844639 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-762cd4dd-15a7-46fc-8e12-38b41bf5cb8a admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:38.845790 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-762cd4dd-15a7-46fc-8e12-38b41bf5cb8a admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/420aabf8-337b-4459-8e5f-41d51dbc13f8 HTTP/1.1" status: 204 len: 168 time: 0.3151920 Dec 09 14:43:38.855628 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-762cd4dd-15a7-46fc-8e12-38b41bf5cb8a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=420aabf8-337b-4459-8e5f-41d51dbc13f8,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:39.176606 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 53598) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:39.220854 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-a031ea07-b440-4d12-8a5d-63ddfbe7b53e admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=9c9bd5ee9cd9458e8b4df2da065cfa12&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0429735 Dec 09 14:43:39.223620 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 53600) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:39.272252 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-44a9e892-30f2-4241-bec9-afe9ca8d2549 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:39.294308 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-44a9e892-30f2-4241-bec9-afe9ca8d2549 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:39.346174 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-44a9e892-30f2-4241-bec9-afe9ca8d2549 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:39.349857 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-44a9e892-30f2-4241-bec9-afe9ca8d2549 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:39.353239 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-44a9e892-30f2-4241-bec9-afe9ca8d2549 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/d5976f9b-3b61-42c9-bf40-eed3fbbdc9b3 HTTP/1.1" status: 204 len: 168 time: 0.1264267 Dec 09 14:43:39.358361 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44a9e892-30f2-4241-bec9-afe9ca8d2549 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5976f9b-3b61-42c9-bf40-eed3fbbdc9b3,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:40.116724 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fad29893-9d3d-4490-aff9-488b9d7d62b5 req-288fb65f-c742-4959-9e37-a40d4f76bb50 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:40.118327 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fad29893-9d3d-4490-aff9-488b9d7d62b5 req-288fb65f-c742-4959-9e37-a40d4f76bb50 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0571001 Dec 09 14:43:40.143483 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bbe7825-7a3d-4f67-ad3c-3e3dac49b8ba req-78a4aa95-3ddd-4191-8014-28f7afbd03bd tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:40.145812 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1bbe7825-7a3d-4f67-ad3c-3e3dac49b8ba req-78a4aa95-3ddd-4191-8014-28f7afbd03bd tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 944 time: 0.0492520 Dec 09 14:43:40.179154 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fad29893-9d3d-4490-aff9-488b9d7d62b5 req-0730d1f1-f137-4ad1-8f2d-3e95d165e9f3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0536437 Dec 09 14:43:40.200785 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1bbe7825-7a3d-4f67-ad3c-3e3dac49b8ba req-3e93ead5-b9f1-4eae-889b-55a9aa245d37 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0488517 Dec 09 14:43:40.243424 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['e559e9a2-7a62-4c44-83c1-bed1dc8d99e6'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:43:40.936306 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e806efe-1cef-484d-ac02-fabfa0120e48 req-4a1b7905-3427-4bc4-bb17-185a1f3facae tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:40.937810 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1e806efe-1cef-484d-ac02-fabfa0120e48 req-4a1b7905-3427-4bc4-bb17-185a1f3facae tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 946 time: 0.0621150 Dec 09 14:43:40.988425 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1e806efe-1cef-484d-ac02-fabfa0120e48 req-d09c6c3c-b40e-47a7-93e1-135b2659486d tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443237 Dec 09 14:43:41.294160 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dacb680f-6f34-46ab-bcde-663526f3146f req-266dc714-a4da-418f-9b48-7a3e2e0dda5c tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:41.295642 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-dacb680f-6f34-46ab-bcde-663526f3146f req-266dc714-a4da-418f-9b48-7a3e2e0dda5c tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0488846 Dec 09 14:43:41.328710 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81e7bda6-7afd-4254-82ee-59c11e9bf1f0 req-ce24297d-c598-443e-bd29-c1501b936e70 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:41.330138 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-81e7bda6-7afd-4254-82ee-59c11e9bf1f0 req-ce24297d-c598-443e-bd29-c1501b936e70 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 944 time: 0.0523844 Dec 09 14:43:41.342626 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-dacb680f-6f34-46ab-bcde-663526f3146f req-746b1d45-6df2-4ffe-b9ad-ead56a9130a9 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408921 Dec 09 14:43:41.598648 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-81e7bda6-7afd-4254-82ee-59c11e9bf1f0 req-1ed3e5cb-66aa-4e8f-a8f4-72bdfa87522b tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2619302 Dec 09 14:43:42.106890 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4774ab5-1cb2-46a5-98c4-dea9d27249e7 req-9ccd45ae-1515-431e-afaf-d48b1f215fe3 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:42.108538 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c4774ab5-1cb2-46a5-98c4-dea9d27249e7 req-9ccd45ae-1515-431e-afaf-d48b1f215fe3 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 946 time: 0.0533304 Dec 09 14:43:42.183951 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c4774ab5-1cb2-46a5-98c4-dea9d27249e7 req-9cf86686-81c2-493e-a428-2135c00d5b0a tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0562842 Dec 09 14:43:43.639759 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:43:43.698482 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:43:43.702374 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:43.702750 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:43.780188 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:43.803430 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84fcfcdd-cc22-49d3-aa97-428cb9a1c56a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e559e9a2-7a62-4c44-83c1-bed1dc8d99e6'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:43.805738 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d911a83-6cab-4a54-bebb-86c08d4373cb" -d '{"events": [{"server_uuid": "84fcfcdd-cc22-49d3-aa97-428cb9a1c56a", "name": "network-vif-plugged", "status": "completed", "tag": "e559e9a2-7a62-4c44-83c1-bed1dc8d99e6"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:43.818474 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port e559e9a2-7a62-4c44-83c1-bed1dc8d99e6, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=e559e9a2-7a62-4c44-83c1-bed1dc8d99e6,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:43.824544 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:43.873273 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=e559e9a2-7a62-4c44-83c1-bed1dc8d99e6,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:44.743413 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:44.810930 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de913725-2c44-4bc5-b41b-bf4580b35f58 req-db063779-1df8-44d3-b922-aebec1c36705 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0423725 Dec 09 14:43:44.937435 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef447601-aebc-4cdb-adb4-6138927596b3 req-6da2c7e3-1eb7-4eb6-a28b-95ff0f11f167 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:44.940100 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ef447601-aebc-4cdb-adb4-6138927596b3 req-6da2c7e3-1eb7-4eb6-a28b-95ff0f11f167 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 945 time: 0.0564368 Dec 09 14:43:44.941703 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40da76de-f206-417f-b841-7a8ae14f1812 req-eb448b5e-4a61-442e-b20c-c23dbeac75ff tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:44.943570 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-40da76de-f206-417f-b841-7a8ae14f1812 req-eb448b5e-4a61-442e-b20c-c23dbeac75ff tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0908556 Dec 09 14:43:44.970020 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de913725-2c44-4bc5-b41b-bf4580b35f58 req-a1acf371-a0d7-4873-ad3a-740ec1aebeef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:44.971398 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de913725-2c44-4bc5-b41b-bf4580b35f58 req-a1acf371-a0d7-4873-ad3a-740ec1aebeef service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=5ec989b7fd3e45f2b8962e012b0797ac&device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 1098 time: 0.0829058 Dec 09 14:43:44.992190 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ef447601-aebc-4cdb-adb4-6138927596b3 req-2f77c397-a914-402a-9ba3-bbf6be13ca42 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470004 Dec 09 14:43:45.021951 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-40da76de-f206-417f-b841-7a8ae14f1812 req-68853969-cda2-4fb0-ae5d-869dedaae431 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710728 Dec 09 14:43:45.069492 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ba60a018-8cb5-426e-9d56-edd7fed89757 x-openstack-request-id: req-ba60a018-8cb5-426e-9d56-edd7fed89757 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:45.069806 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "84fcfcdd-cc22-49d3-aa97-428cb9a1c56a", "name": "network-vif-plugged", "status": "completed", "tag": "e559e9a2-7a62-4c44-83c1-bed1dc8d99e6", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:45.070062 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-ba60a018-8cb5-426e-9d56-edd7fed89757 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:45.070500 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '84fcfcdd-cc22-49d3-aa97-428cb9a1c56a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e559e9a2-7a62-4c44-83c1-bed1dc8d99e6', 'code': 200} Dec 09 14:43:45.102889 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de913725-2c44-4bc5-b41b-bf4580b35f58 req-8b7c64d2-9e8c-452c-a47d-1edb372e2424 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:45.104385 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de913725-2c44-4bc5-b41b-bf4580b35f58 req-8b7c64d2-9e8c-452c-a47d-1edb372e2424 service neutron] 10.222.0.44 "GET /v2.0/networks?id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d HTTP/1.1" status: 200 len: 916 time: 0.0956814 Dec 09 14:43:45.108314 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b936239-3b75-40fb-9c22-4786f649afb6 req-1fc878e9-ae25-486e-81c4-4344659a3d92 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:45.109908 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3b936239-3b75-40fb-9c22-4786f649afb6 req-1fc878e9-ae25-486e-81c4-4344659a3d92 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 946 time: 0.0551617 Dec 09 14:43:45.166284 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3b936239-3b75-40fb-9c22-4786f649afb6 req-722fb1b3-b7af-408e-8415-4c9dd365e566 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0495908 Dec 09 14:43:45.173260 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de913725-2c44-4bc5-b41b-bf4580b35f58 req-fad48f10-9fd6-4396-b38e-4006a694d01b service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=746ea6aa-be43-4fbf-9463-02d741db305a HTTP/1.1" status: 200 len: 217 time: 0.0404432 Dec 09 14:43:45.231175 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de913725-2c44-4bc5-b41b-bf4580b35f58 req-68cdde52-83c9-450c-acf3-db92ff490016 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:45.232793 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de913725-2c44-4bc5-b41b-bf4580b35f58 req-68cdde52-83c9-450c-acf3-db92ff490016 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=7c6b4bb0-bfec-44d0-8503-70917540b3c5 HTTP/1.1" status: 200 len: 855 time: 0.0470436 Dec 09 14:43:45.277125 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de913725-2c44-4bc5-b41b-bf4580b35f58 req-5b76355b-cb2f-4023-8305-8c94e4edea30 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0304570 Dec 09 14:43:45.357486 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c62cc09-591f-435c-8131-ff2deeef6718 req-372f1a96-16e7-4884-bebd-c2cc8c89f828 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:45.359015 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8c62cc09-591f-435c-8131-ff2deeef6718 req-372f1a96-16e7-4884-bebd-c2cc8c89f828 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 1098 time: 0.1047940 Dec 09 14:43:45.419187 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de913725-2c44-4bc5-b41b-bf4580b35f58 req-a84bf556-95ac-4e76-9a3b-5f586e43b1a5 service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1283612 Dec 09 14:43:45.463644 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8c62cc09-591f-435c-8131-ff2deeef6718 req-962c769d-cfac-4a8b-bb5b-3b552be0fa32 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0947704 Dec 09 14:43:45.539357 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de913725-2c44-4bc5-b41b-bf4580b35f58 req-49735117-39da-41a8-a5a0-3489d785ed9d service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1043363 Dec 09 14:43:46.052565 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 53812) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:46.147924 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c65829f3-4d48-4fa1-b61f-94f571817f72 req-412bd9ee-65cb-4278-9ea8-f79ea225e1ff tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:46.149654 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c65829f3-4d48-4fa1-b61f-94f571817f72 req-412bd9ee-65cb-4278-9ea8-f79ea225e1ff tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0513804 Dec 09 14:43:46.150516 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c77d5a86-a01d-45cb-b075-5ba3a72bb2f9 req-be213ad1-106a-4f99-91b1-5322db722f2e tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:46.152088 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c77d5a86-a01d-45cb-b075-5ba3a72bb2f9 req-be213ad1-106a-4f99-91b1-5322db722f2e tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 945 time: 0.0557940 Dec 09 14:43:46.190193 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-730f0596-a3dd-482a-aa79-e4f752b9aead admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:46.202754 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c77d5a86-a01d-45cb-b075-5ba3a72bb2f9 req-09e844d2-57fb-4070-a88b-95cea638c07b tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446746 Dec 09 14:43:46.232256 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c65829f3-4d48-4fa1-b61f-94f571817f72 req-a4f2ae92-046a-401a-b2c2-2cc32a4fc2a6 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0758715 Dec 09 14:43:46.294812 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-730f0596-a3dd-482a-aa79-e4f752b9aead admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:46.299881 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-730f0596-a3dd-482a-aa79-e4f752b9aead admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:46.307450 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fce57fa3-9221-4c90-ad8c-b5d38c9411ac req-75f2b14d-5bb5-4370-a00d-2cdfc31b4264 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:46.309001 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fce57fa3-9221-4c90-ad8c-b5d38c9411ac req-75f2b14d-5bb5-4370-a00d-2cdfc31b4264 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 946 time: 0.0506084 Dec 09 14:43:46.337934 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-730f0596-a3dd-482a-aa79-e4f752b9aead admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=df9bd174a8bb41cbbd9efe0342681474&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2836933 Dec 09 14:43:46.338884 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-730f0596-a3dd-482a-aa79-e4f752b9aead admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6743be16-2f30-4145-bfd8-7e8d2fc6c45f,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:46.341632 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 53818) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:46.371740 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fce57fa3-9221-4c90-ad8c-b5d38c9411ac req-5cbc2852-fb82-4383-9ece-0113cdb33696 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/security-groups?id=2e3b44b4-3206-4554-9176-89efc3ce4a3a&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0567014 Dec 09 14:43:46.407218 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-079a9149-9e6d-4629-81cc-8a6298768a06 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:46.429373 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-079a9149-9e6d-4629-81cc-8a6298768a06 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:46.478040 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-079a9149-9e6d-4629-81cc-8a6298768a06 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:46.480796 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-079a9149-9e6d-4629-81cc-8a6298768a06 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:46.482009 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-079a9149-9e6d-4629-81cc-8a6298768a06 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/6743be16-2f30-4145-bfd8-7e8d2fc6c45f HTTP/1.1" status: 204 len: 168 time: 0.1374381 Dec 09 14:43:46.491556 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-079a9149-9e6d-4629-81cc-8a6298768a06 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6743be16-2f30-4145-bfd8-7e8d2fc6c45f,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:46.617849 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb747b89-3c32-4980-916e-331abd441572 req-ee05c27c-883a-4087-9ad9-3055147218cd tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:46.620177 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-eb747b89-3c32-4980-916e-331abd441572 req-ee05c27c-883a-4087-9ad9-3055147218cd tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.44 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 946 time: 0.0555990 Dec 09 14:43:46.755344 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-eb747b89-3c32-4980-916e-331abd441572 req-2c0c5503-c75e-4be4-8c20-5a11f4ecba77 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Deleting port 64e629a5-6b0c-4cc9-87b6-9a69a3792836 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:43:46.755757 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-eb747b89-3c32-4980-916e-331abd441572 req-2c0c5503-c75e-4be4-8c20-5a11f4ecba77 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:46.785956 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 53832) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:46.800089 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-29a8c856-0fea-48e6-bca6-8c61e0bcd819 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:46.852466 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-eb747b89-3c32-4980-916e-331abd441572 req-2c0c5503-c75e-4be4-8c20-5a11f4ecba77 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] For port 64e629a5-6b0c-4cc9-87b6-9a69a3792836, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=64e629a5-6b0c-4cc9-87b6-9a69a3792836,segment=NetworkSegment(2cc4f8a7-4cb6-4253-83d3-39c4929772e8),segment_id=2cc4f8a7-4cb6-4253-83d3-39c4929772e8)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:46.852839 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-eb747b89-3c32-4980-916e-331abd441572 req-2c0c5503-c75e-4be4-8c20-5a11f4ecba77 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:46.876071 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-eb747b89-3c32-4980-916e-331abd441572 req-2c0c5503-c75e-4be4-8c20-5a11f4ecba77 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Calling delete_port for 64e629a5-6b0c-4cc9-87b6-9a69a3792836 owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:43:46.920527 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-29a8c856-0fea-48e6-bca6-8c61e0bcd819 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:46.926279 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-29a8c856-0fea-48e6-bca6-8c61e0bcd819 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:46.963860 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-29a8c856-0fea-48e6-bca6-8c61e0bcd819 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=80adec8502064d52acd6b67aa0420904&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1764836 Dec 09 14:43:46.966919 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 53842) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:46.979918 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29a8c856-0fea-48e6-bca6-8c61e0bcd819 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c8329ee2-3291-49bf-8780-93c96fb3880b,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:47.025617 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4b95e91a-f606-45bb-9439-7ba5e13dabcd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:47.053285 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4b95e91a-f606-45bb-9439-7ba5e13dabcd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:47.111298 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4b95e91a-f606-45bb-9439-7ba5e13dabcd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:47.114092 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4b95e91a-f606-45bb-9439-7ba5e13dabcd admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:47.119382 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-4b95e91a-f606-45bb-9439-7ba5e13dabcd admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/c8329ee2-3291-49bf-8780-93c96fb3880b HTTP/1.1" status: 204 len: 168 time: 0.1511719 Dec 09 14:43:47.128367 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b95e91a-f606-45bb-9439-7ba5e13dabcd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c8329ee2-3291-49bf-8780-93c96fb3880b,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:47.153454 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-eb747b89-3c32-4980-916e-331abd441572 req-2c0c5503-c75e-4be4-8c20-5a11f4ecba77 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:47.171810 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['64e629a5-6b0c-4cc9-87b6-9a69a3792836'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:43:47.210671 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c0c5503-c75e-4be4-8c20-5a11f4ecba77 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Pushing event deleted for resources: {'Port': ['ID=64e629a5-6b0c-4cc9-87b6-9a69a3792836,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:47.276134 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-eb747b89-3c32-4980-916e-331abd441572 req-2c0c5503-c75e-4be4-8c20-5a11f4ecba77 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] No DVR routers for this DVR port 64e629a5-6b0c-4cc9-87b6-9a69a3792836 on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:43:47.280178 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-eb747b89-3c32-4980-916e-331abd441572 req-2c0c5503-c75e-4be4-8c20-5a11f4ecba77 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:47.284510 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-eb747b89-3c32-4980-916e-331abd441572 req-2c0c5503-c75e-4be4-8c20-5a11f4ecba77 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.44 "DELETE /v2.0/ports/64e629a5-6b0c-4cc9-87b6-9a69a3792836 HTTP/1.1" status: 204 len: 173 time: 0.6559176 Dec 09 14:43:47.285120 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '201d80a0-533f-4dd7-bd29-b19f9a27b094', 'name': 'network-vif-deleted', 'tag': '64e629a5-6b0c-4cc9-87b6-9a69a3792836'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:47.287702 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b127e44d-cb21-4eea-a103-69480e0d2e35" -d '{"events": [{"server_uuid": "201d80a0-533f-4dd7-bd29-b19f9a27b094", "name": "network-vif-deleted", "tag": "64e629a5-6b0c-4cc9-87b6-9a69a3792836"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:47.367674 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baa2e683-0866-4c51-b1c8-19a0343e28e5 req-a7cdcedf-b4bc-4ad4-9fb8-ff8446e79d40 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:47.369827 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-baa2e683-0866-4c51-b1c8-19a0343e28e5 req-a7cdcedf-b4bc-4ad4-9fb8-ff8446e79d40 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 945 time: 0.0712554 Dec 09 14:43:47.415643 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b85e05b-4935-4345-9dd5-40fa492e56bd req-c4908547-73f8-4073-8c45-d005966f85e4 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:47.417212 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0b85e05b-4935-4345-9dd5-40fa492e56bd req-c4908547-73f8-4073-8c45-d005966f85e4 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0852871 Dec 09 14:43:47.475125 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-baa2e683-0866-4c51-b1c8-19a0343e28e5 req-bd963939-60c1-44c9-8f80-c6962cbf227f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811183 Dec 09 14:43:47.495648 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0b85e05b-4935-4345-9dd5-40fa492e56bd req-5ac85616-420a-4566-b280-d8f08c79c01e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708203 Dec 09 14:43:47.520856 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ab17765f-a1fa-410c-9d0c-430a6d1e6fca x-openstack-request-id: req-ab17765f-a1fa-410c-9d0c-430a6d1e6fca {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:47.521265 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "201d80a0-533f-4dd7-bd29-b19f9a27b094", "name": "network-vif-deleted", "tag": "64e629a5-6b0c-4cc9-87b6-9a69a3792836", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:47.521516 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-ab17765f-a1fa-410c-9d0c-430a6d1e6fca {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:47.521914 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '201d80a0-533f-4dd7-bd29-b19f9a27b094', 'name': 'network-vif-deleted', 'tag': '64e629a5-6b0c-4cc9-87b6-9a69a3792836', 'status': 'completed', 'code': 200} Dec 09 14:43:47.598433 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8c37e34c-c5fb-48ae-991d-7d4d8ad5e3b4 req-7330b735-ed5d-420d-82ff-6b4107253c23 tempest-DeleteServersTestJSON-1169994826 tempest-DeleteServersTestJSON-1169994826-project] 10.222.0.39 "GET /v2.0/ports?device_id=201d80a0-533f-4dd7-bd29-b19f9a27b094 HTTP/1.1" status: 200 len: 210 time: 0.0327556 Dec 09 14:43:48.012985 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 53892) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:48.255667 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ce1ee773-0e09-48c9-98c0-da3cfccf5131 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:48.348756 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ce1ee773-0e09-48c9-98c0-da3cfccf5131 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:48.354452 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ce1ee773-0e09-48c9-98c0-da3cfccf5131 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:48.382618 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-ce1ee773-0e09-48c9-98c0-da3cfccf5131 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=cd3263e8c2ba407993ddb250dc0c5dde&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3680983 Dec 09 14:43:48.385107 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 53910) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:48.405435 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce1ee773-0e09-48c9-98c0-da3cfccf5131 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eecfa886-db0a-4af9-b8e2-5be7d5451cd5,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:48.452603 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fc5b9176-aae5-47e1-8f86-a862a20f88bd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:48.481291 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fc5b9176-aae5-47e1-8f86-a862a20f88bd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:48.561807 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fc5b9176-aae5-47e1-8f86-a862a20f88bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:48.567361 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fc5b9176-aae5-47e1-8f86-a862a20f88bd admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:48.568869 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-fc5b9176-aae5-47e1-8f86-a862a20f88bd admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/eecfa886-db0a-4af9-b8e2-5be7d5451cd5 HTTP/1.1" status: 204 len: 168 time: 0.1825233 Dec 09 14:43:48.581453 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc5b9176-aae5-47e1-8f86-a862a20f88bd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eecfa886-db0a-4af9-b8e2-5be7d5451cd5,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:48.649365 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1455695b-dca4-4bd6-871b-175430d794e4 req-f6580877-e720-4eaa-855c-008c7fd9033c tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:48.655815 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1455695b-dca4-4bd6-871b-175430d794e4 req-f6580877-e720-4eaa-855c-008c7fd9033c tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0681398 Dec 09 14:43:48.752932 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1455695b-dca4-4bd6-871b-175430d794e4 req-ec41f0fb-bdee-405c-8543-f9be36382dd8 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0961332 Dec 09 14:43:49.378973 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 53974) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:49.507639 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-03b52019-2cda-46c4-82f0-1f02cba07f32 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:49.588124 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-03b52019-2cda-46c4-82f0-1f02cba07f32 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:49.594465 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-03b52019-2cda-46c4-82f0-1f02cba07f32 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:49.636094 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-03b52019-2cda-46c4-82f0-1f02cba07f32 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=04c9a402946047a1b208001a2143797e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2550721 Dec 09 14:43:49.639221 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54000) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:49.646330 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03b52019-2cda-46c4-82f0-1f02cba07f32 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e74afcc-de3b-4acb-8e57-b94094433e44,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:49.662953 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54002) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:49.699192 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-10b554c5-141e-4b78-b5e0-9ee83f753c94 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:49.733559 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-10b554c5-141e-4b78-b5e0-9ee83f753c94 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:49.736784 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-9c00715b-b6da-4c4a-aa9f-2cc5f74c4dbe tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:49.738286 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-9c00715b-b6da-4c4a-aa9f-2cc5f74c4dbe tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/networks?id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d HTTP/1.1" status: 200 len: 815 time: 0.1081667 Dec 09 14:43:49.754221 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-b4cf3ddc-ba69-44a0-b8bd-cbb71176097e tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/quotas/5ec989b7fd3e45f2b8962e012b0797ac HTTP/1.1" status: 200 len: 375 time: 0.0095232 Dec 09 14:43:49.787283 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-10b554c5-141e-4b78-b5e0-9ee83f753c94 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:49.790917 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-10b554c5-141e-4b78-b5e0-9ee83f753c94 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:49.795184 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-10b554c5-141e-4b78-b5e0-9ee83f753c94 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/2e74afcc-de3b-4acb-8e57-b94094433e44 HTTP/1.1" status: 204 len: 168 time: 0.1519957 Dec 09 14:43:49.798958 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-663400605-network', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:49.818772 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10b554c5-141e-4b78-b5e0-9ee83f753c94 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e74afcc-de3b-4acb-8e57-b94094433e44,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:49.822233 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-338383ad-6d82-4f2c-ac6d-2a91ab4db5d5 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=5ec989b7fd3e45f2b8962e012b0797ac&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0612321 Dec 09 14:43:49.855538 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] Made reservation on behalf of 10d73d0acf44499e88f6d53847b2094e for: {'network': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:43:49.858396 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:49.874654 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:49.950507 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-0de7b28c-0aa3-4cfc-aa22-24b57766a686 service neutron] 10.222.0.39 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1272998 Dec 09 14:43:49.962779 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2cccbcb-cb42-4162-86e8-41a76dc6b234 req-c83365de-278d-4fee-bf84-d009a97d3123 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:49.970113 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f2cccbcb-cb42-4162-86e8-41a76dc6b234 req-c83365de-278d-4fee-bf84-d009a97d3123 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0789542 Dec 09 14:43:50.043150 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f2cccbcb-cb42-4162-86e8-41a76dc6b234 req-af4f18f1-9800-47e4-b39b-90304b9fbe11 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721569 Dec 09 14:43:50.047734 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.053208 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.065852 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-cf16bedd-e6fb-4c81-b546-035063902cd5 service neutron] 10.222.0.39 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1026046 Dec 09 14:43:50.075474 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 449} {{(pid=109062) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:43:50.091302 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=18ffe91a-1656-4030-9b32-0fa66943ae07,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:50.096235 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.096841 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.segments_db [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] Added segment a2b92707-4465-4444-9285-42fd2c8881e1 of type vlan for network f0982548-601b-4206-88dc-a16a0317b421 Dec 09 14:43:50.138950 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.165244 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.166337 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:50.167005 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.204277 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 54020) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:50.226279 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-915c5a67-7238-4605-8119-7f4b4b7a07d4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.258493 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 0.5943365 Dec 09 14:43:50.266787 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 54028) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:50.271816 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-9a75868e-40b7-4f11-ab65-317c17e5d61a admin admin] Request body: {'subnet': {'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-663400605-subnet', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'ip_version': 4}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:50.297910 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fdc10ca9-70a6-4bf9-86c8-6aeb0e102476 req-d8a8fe36-63d1-496c-bdba-4c4ec4f94432 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 210 time: 0.0711334 Dec 09 14:43:50.325993 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2bc53f0-d335-4eb2-a174-7aa21704127a admin admin] Pushing event updated for resources: {'Network': ['ID=f0982548-601b-4206-88dc-a16a0317b421,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:50.327761 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9a75868e-40b7-4f11-ab65-317c17e5d61a admin admin] Made reservation on behalf of 10d73d0acf44499e88f6d53847b2094e for: {'subnet': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:43:50.332378 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-9a75868e-40b7-4f11-ab65-317c17e5d61a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-133483919'] for subnet, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.337825 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network f0982548-601b-4206-88dc-a16a0317b421 details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:43:50.347422 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54034) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:50.401443 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_v2 [None req-7ade7506-f0b5-4fcc-83cb-60dee72a9598 admin admin] Deleting subnet ae0e8ccb-a0a9-4f5b-93f6-77fb4806d03e {{(pid=109062) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:43:50.411722 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7ade7506-f0b5-4fcc-83cb-60dee72a9598 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.438612 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-915c5a67-7238-4605-8119-7f4b4b7a07d4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.454846 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7ade7506-f0b5-4fcc-83cb-60dee72a9598 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-130415749'] for subnet, precommit_delete_associations {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.455931 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-915c5a67-7238-4605-8119-7f4b4b7a07d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.484999 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-915c5a67-7238-4605-8119-7f4b4b7a07d4 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=5730bca540cb4aa7a6aaecf89add8fa3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2792897 Dec 09 14:43:50.487734 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54042) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:50.502793 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7ade7506-f0b5-4fcc-83cb-60dee72a9598 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.513763 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-915c5a67-7238-4605-8119-7f4b4b7a07d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=553651d4-9a20-4984-aba0-79a2b4b0c7e9,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:50.594734 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7ade7506-f0b5-4fcc-83cb-60dee72a9598 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-130461228', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-130768914'] for subnet, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.615207 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-9a75868e-40b7-4f11-ab65-317c17e5d61a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-133412248', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-133640805'] for subnet, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.629565 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ade7506-f0b5-4fcc-83cb-60dee72a9598 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ae0e8ccb-a0a9-4f5b-93f6-77fb4806d03e,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:50.633484 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4a93c409-8b4b-403c-bfa6-253eef683785 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.635868 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7ade7506-f0b5-4fcc-83cb-60dee72a9598 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.640280 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-7ade7506-f0b5-4fcc-83cb-60dee72a9598 admin admin] 10.222.0.39 "DELETE /v2.0/subnets/ae0e8ccb-a0a9-4f5b-93f6-77fb4806d03e HTTP/1.1" status: 204 len: 168 time: 0.2918799 Dec 09 14:43:50.644146 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54046) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:50.676960 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a75868e-40b7-4f11-ab65-317c17e5d61a admin admin] Pushing event updated for resources: {'Subnet': ['ID=7edf1e5e-d953-4e3c-8dc5-29475e258db2,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:50.685382 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9a75868e-40b7-4f11-ab65-317c17e5d61a admin admin] Checking segment: {'id': 'a2b92707-4465-4444-9285-42fd2c8881e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:43:50.685735 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a75868e-40b7-4f11-ab65-317c17e5d61a admin admin] Network hostable DHCP agents. Network: f0982548-601b-4206-88dc-a16a0317b421, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109061) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:43:50.705091 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9a75868e-40b7-4f11-ab65-317c17e5d61a admin admin] Network f0982548-601b-4206-88dc-a16a0317b421 is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109061) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:43:50.725571 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-9a75868e-40b7-4f11-ab65-317c17e5d61a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, f0982548-601b-4206-88dc-a16a0317b421) {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:43:50.726294 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4a93c409-8b4b-403c-bfa6-253eef683785 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.730112 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9a75868e-40b7-4f11-ab65-317c17e5d61a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:50.730691 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-9a75868e-40b7-4f11-ab65-317c17e5d61a admin admin] Publish callbacks [] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.737378 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d701749-72c0-4e8c-8fb7-365f1aa7e572 None None] Network f0982548-601b-4206-88dc-a16a0317b421 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:43:50.744947 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 64e629a5-6b0c-4cc9-87b6-9a69a3792836 no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:43:50.753442 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-9a75868e-40b7-4f11-ab65-317c17e5d61a admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.4855421 Dec 09 14:43:50.756469 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 54048) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:50.763977 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:50.772897 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-424110ee-ed6f-4f08-bc9d-525fc8934afb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.795851 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1626853', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30590'] for router, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.798641 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1626745', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1584168', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1653733', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30569'] for router, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.814715 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: 64e629a5-6b0c-4cc9-87b6-9a69a3792836 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:43:50.815214 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 64e629a5-6b0c-4cc9-87b6-9a69a3792836 not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:43:50.873326 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4a93c409-8b4b-403c-bfa6-253eef683785 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.876310 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4a93c409-8b4b-403c-bfa6-253eef683785 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.878907 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-4a93c409-8b4b-403c-bfa6-253eef683785 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/553651d4-9a20-4984-aba0-79a2b4b0c7e9 HTTP/1.1" status: 204 len: 168 time: 0.3899465 Dec 09 14:43:50.880834 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-424110ee-ed6f-4f08-bc9d-525fc8934afb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.891287 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp191c2114-7e35-566a-a422-2a0bb50a5442-f0982548-601b-4206-88dc-a16a0317b421', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'fixed_ips': [{'subnet_id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2'}]}} from dv-cinder-819692-8-iscsi. {{(pid=109063) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 14:43:50.892210 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.920181 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a93c409-8b4b-403c-bfa6-253eef683785 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=553651d4-9a20-4984-aba0-79a2b4b0c7e9,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:50.925875 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:50.954827 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-424110ee-ed6f-4f08-bc9d-525fc8934afb admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['51590e0b-46a5-4e2e-8094-5ee83cac94b5']}} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:50.969515 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-424110ee-ed6f-4f08-bc9d-525fc8934afb admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2cc4f8a7-4cb6-4253-83d3-39c4929772e8') {'for_net_delete': True} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:50.970119 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-424110ee-ed6f-4f08-bc9d-525fc8934afb admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2cc4f8a7-4cb6-4253-83d3-39c4929772e8') {} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:50.979861 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-424110ee-ed6f-4f08-bc9d-525fc8934afb admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-130415758'] for segment, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.018313 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-424110ee-ed6f-4f08-bc9d-525fc8934afb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.030350 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-424110ee-ed6f-4f08-bc9d-525fc8934afb admin admin] Releasing vlan 400 on physical network physnet1 to pool {{(pid=109062) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:43:51.030751 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-424110ee-ed6f-4f08-bc9d-525fc8934afb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-130461398'] for segment, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: Traceback (most recent call last): Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: timer() Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: cb(*args, **kw) Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: return func(*args, **kwargs) Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: self._notify() Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: self.callback(batched_events) Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: event.method(event) Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: return f(self, *a, **k) Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._get(url).json() Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: return self.request(url, 'GET', **kwargs) Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:43:51.032827 dv-cinder-819692-8-iscsi neutron-server[109062]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:43:51.098716 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.db_base_plugin_common [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Allocated IP 172.20.0.2 (f0982548-601b-4206-88dc-a16a0317b421/7edf1e5e-d953-4e3c-8dc5-29475e258db2/8b6f9d9a-d11e-4ffb-bb62-128ad19cd496) {{(pid=109063) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:43:51.105222 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-424110ee-ed6f-4f08-bc9d-525fc8934afb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.114479 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-424110ee-ed6f-4f08-bc9d-525fc8934afb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.118201 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-424110ee-ed6f-4f08-bc9d-525fc8934afb admin admin] 10.222.0.39 "DELETE /v2.0/networks/51590e0b-46a5-4e2e-8094-5ee83cac94b5 HTTP/1.1" status: 204 len: 168 time: 0.4703882 Dec 09 14:43:51.143648 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-424110ee-ed6f-4f08-bc9d-525fc8934afb admin admin] Pushing event deleted for resources: {'Network': ['ID=51590e0b-46a5-4e2e-8094-5ee83cac94b5,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:51.190467 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.273486 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04bea0b6-781c-45bd-b9e9-f137680ca245 req-16b1bd79-a40b-493d-b42f-7efc7efb4d69 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:51.275319 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-04bea0b6-781c-45bd-b9e9-f137680ca245 req-16b1bd79-a40b-493d-b42f-7efc7efb4d69 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0863421 Dec 09 14:43:51.351558 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-04bea0b6-781c-45bd-b9e9-f137680ca245 req-299706d3-9703-41e7-b017-04d9fbc3315b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647843 Dec 09 14:43:51.403435 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54072) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:51.415387 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Publish callbacks [] for port, precommit_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.435019 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.464167 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-62b0238c-3cc0-48e3-966d-5c9160363144 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=1c1fb4e2e42c41e6bfff5cb72fe05656&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0594196 Dec 09 14:43:51.465180 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54074) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:51.482541 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Pushing event updated for resources: {'Port': ['ID=8b6f9d9a-d11e-4ffb-bb62-128ad19cd496,revision_number=1']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:51.500171 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Network f0982548-601b-4206-88dc-a16a0317b421 is already hosted by enough agents. {{(pid=109063) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:43:51.501729 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.base_scheduler [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Resources bound (agent type, host, resource id): {{(pid=109063) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:43:51.505556 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Received port after_create {{(pid=109063) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:43:51.511441 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6ca03737-7ce2-4bd4-99a5-26807301ae59 req-f3ff1da2-90f2-468b-8d93-c2d3a7bbca4b tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 210 time: 0.0461056 Dec 09 14:43:51.556962 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.580732 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b8a15c06-591f-4b89-a5cd-fd14b59e8942 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.593108 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.611297 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Attempting to bind port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:43:51.611711 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Attempting to bind port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'a2b92707-4465-4444-9285-42fd2c8881e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:43:51.612084 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Attempting to bind port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 on network f0982548-601b-4206-88dc-a16a0317b421 {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:43:51.626161 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 43, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:43:51.626452 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Checking segment: {'id': 'a2b92707-4465-4444-9285-42fd2c8881e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:43:51.626922 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.627330 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Bound using segment: {'id': 'a2b92707-4465-4444-9285-42fd2c8881e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:43:51.627857 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Bound port: 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a2b92707-4465-4444-9285-42fd2c8881e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:43:51.628233 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.643003 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b8a15c06-591f-4b89-a5cd-fd14b59e8942 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.706949 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b8a15c06-591f-4b89-a5cd-fd14b59e8942 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.709875 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b8a15c06-591f-4b89-a5cd-fd14b59e8942 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.728289 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-b8a15c06-591f-4b89-a5cd-fd14b59e8942 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/2e3b44b4-3206-4554-9176-89efc3ce4a3a HTTP/1.1" status: 204 len: 168 time: 0.2456398 Dec 09 14:43:51.731000 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] For port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:43:51.737315 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] For port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=8b6f9d9a-d11e-4ffb-bb62-128ad19cd496,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:43:51.749386 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:51.756857 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8a15c06-591f-4b89-a5cd-fd14b59e8942 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e3b44b4-3206-4554-9176-89efc3ce4a3a,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:51.790227 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Allocated IP 172.27.0.153 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/d811a33d-c420-4cb6-9ca9-cc0a9c770df5) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:43:51.909395 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0668c7dc-9e47-4117-abdd-b6e7d8cb9144 None None] Pushing event updated for resources: {'Port': ['ID=8b6f9d9a-d11e-4ffb-bb62-128ad19cd496,revision_number=2']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:51.910921 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-7f5ea25a-8993-4699-8971-177b70a8b80f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:51.912543 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-7f5ea25a-8993-4699-8971-177b70a8b80f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "GET /v2.0/networks?id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d HTTP/1.1" status: 200 len: 815 time: 0.1919816 Dec 09 14:43:51.932539 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-7743dd65-c793-4c93-b82b-2a4a4fdf9146 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Request body: {'port': {'device_id': '151740c8-abee-4794-ae76-20ebd9c216c8', 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d', 'admin_state_up': True, 'tenant_id': '5ec989b7fd3e45f2b8962e012b0797ac'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:52.039372 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:52.114179 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:52.124567 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-7743dd65-c793-4c93-b82b-2a4a4fdf9146 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Made reservation on behalf of 5ec989b7fd3e45f2b8962e012b0797ac for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:43:52.128278 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-7743dd65-c793-4c93-b82b-2a4a4fdf9146 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:52.185484 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:43:52.190489 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:43:52.198512 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:43:52.284892 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Pushing event updated for resources: {'Port': ['ID=d811a33d-c420-4cb6-9ca9-cc0a9c770df5,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:52.562858 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54120) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:52.645240 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-04650dbe-e694-492e-9561-32dd7554bb03 req-0044e652-dc96-49d9-9b1e-02be6ebbc32d tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 210 time: 0.0305827 Dec 09 14:43:52.824297 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-7743dd65-c793-4c93-b82b-2a4a4fdf9146 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Allocated IP 172.20.0.12 (99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d/7c6b4bb0-bfec-44d0-8503-70917540b3c5/f52c3419-227a-4edd-add3-ffd3eea75b9d) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:43:52.868730 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dbc3aa5-724e-461a-9040-fe43cd5e24d3 req-8342b5b6-6716-4940-a163-0f22e4348e75 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:52.871556 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1dbc3aa5-724e-461a-9040-fe43cd5e24d3 req-8342b5b6-6716-4940-a163-0f22e4348e75 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.2526610 Dec 09 14:43:52.894231 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6bdcffaa-b2c5-4044-9cdb-f2cc47c2e025 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.115900 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:43:53.132402 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6bdcffaa-b2c5-4044-9cdb-f2cc47c2e025 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.142047 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6bdcffaa-b2c5-4044-9cdb-f2cc47c2e025 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.173026 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1dbc3aa5-724e-461a-9040-fe43cd5e24d3 req-8bb13b25-2178-4cd6-a563-a8ceb7fc9b63 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2885160 Dec 09 14:43:53.244525 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:53.245237 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.246164 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-6bdcffaa-b2c5-4044-9cdb-f2cc47c2e025 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=a374f7c7d2b449febbed4fe5627096d5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6821761 Dec 09 14:43:53.247909 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6bdcffaa-b2c5-4044-9cdb-f2cc47c2e025 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ae6ac7a9-40f5-4cf7-80c2-15421c37ec7c,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:53.256959 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54142) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:53.264526 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-7743dd65-c793-4c93-b82b-2a4a4fdf9146 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.304678 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.321023 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b3de005f-e045-4afd-8259-8a5441d00118 None None] Network f0982548-601b-4206-88dc-a16a0317b421 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:43:53.347744 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-7743dd65-c793-4c93-b82b-2a4a4fdf9146 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.368385 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['746ea6aa-be43-4fbf-9463-02d741db305a', 'e559e9a2-7a62-4c44-83c1-bed1dc8d99e6'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:43:53.398688 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-7743dd65-c793-4c93-b82b-2a4a4fdf9146 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:43:53.399582 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-13fe415e-33a6-4a1b-81dd-d25791cf68fa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.406326 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-7743dd65-c793-4c93-b82b-2a4a4fdf9146 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:43:53.416179 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-7743dd65-c793-4c93-b82b-2a4a4fdf9146 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:43:53.458575 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-13fe415e-33a6-4a1b-81dd-d25791cf68fa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.472761 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7743dd65-c793-4c93-b82b-2a4a4fdf9146 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Pushing event updated for resources: {'Port': ['ID=f52c3419-227a-4edd-add3-ffd3eea75b9d,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:53.541368 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-13fe415e-33a6-4a1b-81dd-d25791cf68fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.545780 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-13fe415e-33a6-4a1b-81dd-d25791cf68fa admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.550212 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-13fe415e-33a6-4a1b-81dd-d25791cf68fa admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/ae6ac7a9-40f5-4cf7-80c2-15421c37ec7c HTTP/1.1" status: 204 len: 168 time: 0.2916954 Dec 09 14:43:53.550376 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-c2ff8284-302d-40e7-bd40-81064643eda7 None None] Provisioning complete for port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:53.550723 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-c2ff8284-302d-40e7-bd40-81064643eda7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.553960 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-7743dd65-c793-4c93-b82b-2a4a4fdf9146 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:53.554637 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-7743dd65-c793-4c93-b82b-2a4a4fdf9146 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.558907 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13fe415e-33a6-4a1b-81dd-d25791cf68fa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ae6ac7a9-40f5-4cf7-80c2-15421c37ec7c,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:53.623875 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-7743dd65-c793-4c93-b82b-2a4a4fdf9146 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.6963902 Dec 09 14:43:53.647137 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Request body: {'port': {'device_id': '151740c8-abee-4794-ae76-20ebd9c216c8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:53.746700 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.819575 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.833993 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] For port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=8b6f9d9a-d11e-4ffb-bb62-128ad19cd496,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:53.841010 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1626736', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1574391'] for router, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.853173 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:53.868567 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5704ab12-7469-43ec-b8bd-e22b38ad1307 req-96e6514d-64cf-40e5-83b0-ff5ad3600dd9 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:53.876248 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5704ab12-7469-43ec-b8bd-e22b38ad1307 req-96e6514d-64cf-40e5-83b0-ff5ad3600dd9 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 932 time: 0.1146305 Dec 09 14:43:53.969394 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Pushing event updated for resources: {'Port': ['ID=8b6f9d9a-d11e-4ffb-bb62-128ad19cd496,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:54.035857 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5704ab12-7469-43ec-b8bd-e22b38ad1307 req-7c5bff00-536a-492f-9ad8-e90ace1605c4 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1496699 Dec 09 14:43:54.189964 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-82c728fe-7a9e-4d88-b6d8-cb79ba9864c8 None None] Provisioning complete for port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:54.190427 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-82c728fe-7a9e-4d88-b6d8-cb79ba9864c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:54.236939 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54178) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:54.257663 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d841622b-6a69-4c31-b1da-42d820ead3db admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:54.387725 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 54180) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:54.398459 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d841622b-6a69-4c31-b1da-42d820ead3db admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:54.403725 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d841622b-6a69-4c31-b1da-42d820ead3db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:54.404002 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f52c3419-227a-4edd-add3-ffd3eea75b9d {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:43:54.417261 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:54.423426 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 is scheduled to L3 agent d9048829-2654-4d94-83cc-155a0884505e with binding_index 1 {{(pid=109061) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 14:43:54.443590 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d841622b-6a69-4c31-b1da-42d820ead3db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=32063767-42d9-4b9a-8359-ed8cf223cb7a,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:54.444827 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa403227-8b58-4f41-b43e-138f24a54c3f req-0ba69984-89b6-4e9b-bacf-c7704903b855 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:54.446469 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-aa403227-8b58-4f41-b43e-138f24a54c3f req-0ba69984-89b6-4e9b-bacf-c7704903b855 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.1361568 Dec 09 14:43:54.450894 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Transition to ACTIVE for port object f52c3419-227a-4edd-add3-ffd3eea75b9d will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:43:54.462315 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-d841622b-6a69-4c31-b1da-42d820ead3db admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=806039eb97b24e83a66375d1bfc680ab&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2240202 Dec 09 14:43:54.465273 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54186) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:54.466394 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:54.541417 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1de5c763-8b97-4d4e-b1d6-478a287ebdcb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:54.569941 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1de5c763-8b97-4d4e-b1d6-478a287ebdcb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:54.622562 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Pushing event updated for resources: {'Port': ['ID=f52c3419-227a-4edd-add3-ffd3eea75b9d,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:54.633163 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-aa403227-8b58-4f41-b43e-138f24a54c3f req-3bf6a56d-5feb-473e-9c5b-c7ebba7c1dbb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1778641 Dec 09 14:43:54.637082 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1de5c763-8b97-4d4e-b1d6-478a287ebdcb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:54.641578 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1de5c763-8b97-4d4e-b1d6-478a287ebdcb admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:54.643661 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-1de5c763-8b97-4d4e-b1d6-478a287ebdcb admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/32063767-42d9-4b9a-8359-ed8cf223cb7a HTTP/1.1" status: 204 len: 168 time: 0.1758280 Dec 09 14:43:54.658016 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1de5c763-8b97-4d4e-b1d6-478a287ebdcb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=32063767-42d9-4b9a-8359-ed8cf223cb7a,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:54.669899 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c99795d7-f32d-41a1-a7ce-7a581b4de9d2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:54.721390 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:43:54.737161 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Sync routers for ids ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:43:54.750210 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Routers {'ff4d224c-d767-4521-9fd6-3bfbaaddfe44'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:43:54.751168 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:43:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:54.771080 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:54.775266 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-22752290-5ae4-4f14-9e40-4b77af10ecc1 admin admin] 10.222.0.39 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 4.0178130 Dec 09 14:43:54.775449 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54194) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:54.784563 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Attempting to bind port f52c3419-227a-4edd-add3-ffd3eea75b9d on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:43:54.784905 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Attempting to bind port f52c3419-227a-4edd-add3-ffd3eea75b9d by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:43:54.785240 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Attempting to bind port f52c3419-227a-4edd-add3-ffd3eea75b9d on network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:43:54.794899 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Port f52c3419-227a-4edd-add3-ffd3eea75b9d on network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:43:54.795237 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Attempting to bind port f52c3419-227a-4edd-add3-ffd3eea75b9d on network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:43:54.805682 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 43, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:43:54.806058 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Checking segment: {'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:43:54.806423 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Bound using segment: {'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:43:54.806861 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Bound port: f52c3419-227a-4edd-add3-ffd3eea75b9d, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:43:54.807229 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:54.865595 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c99795d7-f32d-41a1-a7ce-7a581b4de9d2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:54.879725 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c99795d7-f32d-41a1-a7ce-7a581b4de9d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:54.889384 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Set router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:43:54.941624 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] For port f52c3419-227a-4edd-add3-ffd3eea75b9d, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:43:54.945587 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c99795d7-f32d-41a1-a7ce-7a581b4de9d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5e4670a6-b93d-478f-99ed-6c965d326da4,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:54.952315 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-c99795d7-f32d-41a1-a7ce-7a581b4de9d2 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=657041af9fc64d1da740339bcd5ad5cb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5585568 Dec 09 14:43:54.955153 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54200) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:54.963556 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] For port f52c3419-227a-4edd-add3-ffd3eea75b9d, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=f52c3419-227a-4edd-add3-ffd3eea75b9d,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:43:54.971878 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:55.069287 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7193a4d8-f5ae-4430-a10a-2d4c7f68a232 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:55.081512 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:43:55.087094 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:55.087752 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:55.089186 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] 10.222.0.44 "PUT /v2.0/ports/f52c3419-227a-4edd-add3-ffd3eea75b9d HTTP/1.1" status: 200 len: 1094 time: 1.4482715 Dec 09 14:43:55.089635 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '151740c8-abee-4794-ae76-20ebd9c216c8', 'tag': 'f52c3419-227a-4edd-add3-ffd3eea75b9d'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:43:55.099714 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c349e99c-2913-46b8-8b1d-f8299017b9d6" -d '{"events": [{"name": "network-changed", "server_uuid": "151740c8-abee-4794-ae76-20ebd9c216c8", "tag": "f52c3419-227a-4edd-add3-ffd3eea75b9d"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:43:55.134168 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7193a4d8-f5ae-4430-a10a-2d4c7f68a232 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:55.140219 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-085655ad-c5f9-40b7-8194-9d8a0c7d67c9 service neutron] Pushing event updated for resources: {'Port': ['ID=f52c3419-227a-4edd-add3-ffd3eea75b9d,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:55.243781 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:43:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6dcf0953-f0d5-412a-bfca-8128389584a1 x-openstack-request-id: req-6dcf0953-f0d5-412a-bfca-8128389584a1 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:43:55.244560 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "151740c8-abee-4794-ae76-20ebd9c216c8", "tag": "f52c3419-227a-4edd-add3-ffd3eea75b9d", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:43:55.244912 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-6dcf0953-f0d5-412a-bfca-8128389584a1 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:43:55.245436 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '151740c8-abee-4794-ae76-20ebd9c216c8', 'tag': 'f52c3419-227a-4edd-add3-ffd3eea75b9d', 'status': 'completed', 'code': 200} Dec 09 14:43:55.254724 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:50Z', 'updated_at': '2021-12-09T14:43:52Z', 'revision_number': 3, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'gw_port': {'id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:38:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:51Z', 'updated_at': '2021-12-09T14:43:51Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:55.265574 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-d878e300-f7db-470a-88be-52d5756a6c5d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:55.267567 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-d878e300-f7db-470a-88be-52d5756a6c5d service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=5ec989b7fd3e45f2b8962e012b0797ac&device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 1097 time: 0.1160915 Dec 09 14:43:55.267731 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:55.268226 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:55.345680 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Checking router: ff4d224c-d767-4521-9fd6-3bfbaaddfe44 for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:43:55.346011 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Updating router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 port d811a33d-c420-4cb6-9ca9-cc0a9c770df5 binding host dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:43:55.382954 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-b837278a-82e6-449e-9e92-772587bc99f3 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=f52c3419-227a-4edd-add3-ffd3eea75b9d HTTP/1.1" status: 200 len: 217 time: 0.0965581 Dec 09 14:43:55.395235 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:55.467424 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7a61cb8-1322-4f8d-ab3a-1e5d42119682 req-45faa7ef-7fa4-4ae8-a8f8-ceac7944ef20 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:55.479117 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f7a61cb8-1322-4f8d-ab3a-1e5d42119682 req-45faa7ef-7fa4-4ae8-a8f8-ceac7944ef20 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 944 time: 0.2171884 Dec 09 14:43:55.487354 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7193a4d8-f5ae-4430-a10a-2d4c7f68a232 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:55.491316 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7193a4d8-f5ae-4430-a10a-2d4c7f68a232 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:55.495952 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-7193a4d8-f5ae-4430-a10a-2d4c7f68a232 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/5e4670a6-b93d-478f-99ed-6c965d326da4 HTTP/1.1" status: 204 len: 168 time: 0.5397382 Dec 09 14:43:55.498079 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-c9e6615a-1e73-4ed0-a97a-560f7e9c8dbe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:55.501207 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-c9e6615a-1e73-4ed0-a97a-560f7e9c8dbe service neutron] 10.222.0.44 "GET /v2.0/subnets?id=7c6b4bb0-bfec-44d0-8503-70917540b3c5 HTTP/1.1" status: 200 len: 855 time: 0.0927277 Dec 09 14:43:55.531126 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7193a4d8-f5ae-4430-a10a-2d4c7f68a232 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5e4670a6-b93d-478f-99ed-6c965d326da4,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:55.584983 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-67bc2512-c7de-4e32-a516-6de13c7dc3ee service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0602069 Dec 09 14:43:55.652841 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f7a61cb8-1322-4f8d-ab3a-1e5d42119682 req-05030f50-34bf-437c-ba96-fc63117dbbe7 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1709423 Dec 09 14:43:55.778947 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-2952480a-5fbd-4ecf-8df2-767b77353b69 service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1752026 Dec 09 14:43:55.891454 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Publish callbacks [] for port, precommit_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:55.892319 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:55.900684 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:55.919373 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-82e7f57d-1669-43a2-b52f-f80b6123f3d4 req-85b502c4-8192-4ad7-9eab-5f9fb3b1ebc0 service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1275003 Dec 09 14:43:55.941020 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-716eab56-bf58-4853-bda2-6f9e51ffbb77 req-7ff864ad-3a13-4a82-ba71-de8d774f617b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:55.944490 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-716eab56-bf58-4853-bda2-6f9e51ffbb77 req-7ff864ad-3a13-4a82-ba71-de8d774f617b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.1645854 Dec 09 14:43:55.962141 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54240) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:55.972829 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d719ba4-00a3-44d3-bab5-846ff0f5d7c8 None None] Pushing event updated for resources: {'Port': ['ID=d811a33d-c420-4cb6-9ca9-cc0a9c770df5,revision_number=2']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:55.981628 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-41561b6c-dd36-41c3-90a1-c1e00e67fb75 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:55.984268 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d719ba4-00a3-44d3-bab5-846ff0f5d7c8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:55.984842 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d719ba4-00a3-44d3-bab5-846ff0f5d7c8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:55.985365 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d719ba4-00a3-44d3-bab5-846ff0f5d7c8 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:55.986393 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d719ba4-00a3-44d3-bab5-846ff0f5d7c8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:55.986887 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d719ba4-00a3-44d3-bab5-846ff0f5d7c8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:55.988435 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d719ba4-00a3-44d3-bab5-846ff0f5d7c8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:55.989017 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d719ba4-00a3-44d3-bab5-846ff0f5d7c8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:55.989533 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d719ba4-00a3-44d3-bab5-846ff0f5d7c8 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:55.990662 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d719ba4-00a3-44d3-bab5-846ff0f5d7c8 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:55.991204 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d719ba4-00a3-44d3-bab5-846ff0f5d7c8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:55.991731 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d719ba4-00a3-44d3-bab5-846ff0f5d7c8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:55.992276 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d719ba4-00a3-44d3-bab5-846ff0f5d7c8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:55.992847 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3d719ba4-00a3-44d3-bab5-846ff0f5d7c8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:43:56.014878 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Attempting to bind port d811a33d-c420-4cb6-9ca9-cc0a9c770df5 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:43:56.015578 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Attempting to bind port d811a33d-c420-4cb6-9ca9-cc0a9c770df5 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:43:56.016197 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Attempting to bind port d811a33d-c420-4cb6-9ca9-cc0a9c770df5 on network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:43:56.021965 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 43, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:43:56.022457 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Checking segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109064) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:43:56.022915 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:56.023359 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Bound using segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:43:56.024072 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Bound port: d811a33d-c420-4cb6-9ca9-cc0a9c770df5, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:43:56.024539 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:56.078158 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-716eab56-bf58-4853-bda2-6f9e51ffbb77 req-c69981f7-fade-4b77-909e-067c1b6c3b20 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1236827 Dec 09 14:43:56.082794 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] For port d811a33d-c420-4cb6-9ca9-cc0a9c770df5, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109064) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:43:56.087199 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] For port d811a33d-c420-4cb6-9ca9-cc0a9c770df5, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=d811a33d-c420-4cb6-9ca9-cc0a9c770df5,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109064) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:43:56.092793 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c349e99c-2913-46b8-8b1d-f8299017b9d6 req-1089d81d-6f94-44e4-935a-dd222435653a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:56.096547 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:56.101101 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c349e99c-2913-46b8-8b1d-f8299017b9d6 req-1089d81d-6f94-44e4-935a-dd222435653a service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=5ec989b7fd3e45f2b8962e012b0797ac&device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 1097 time: 0.1016250 Dec 09 14:43:56.129573 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-41561b6c-dd36-41c3-90a1-c1e00e67fb75 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:56.151120 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Routers {'ff4d224c-d767-4521-9fd6-3bfbaaddfe44'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:43:56.151741 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:43:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:56.155432 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-41561b6c-dd36-41c3-90a1-c1e00e67fb75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:56.194438 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-41561b6c-dd36-41c3-90a1-c1e00e67fb75 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=1975aa8cb9bd4422971c07daf15d6d57&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2304535 Dec 09 14:43:56.198728 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54248) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:56.198884 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d719ba4-00a3-44d3-bab5-846ff0f5d7c8 None None] Pushing event updated for resources: {'Port': ['ID=d811a33d-c420-4cb6-9ca9-cc0a9c770df5,revision_number=3']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:56.223548 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c349e99c-2913-46b8-8b1d-f8299017b9d6 req-d4030ab2-bbc0-4e65-83a2-9cb3f7bd5663 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:56.225378 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c349e99c-2913-46b8-8b1d-f8299017b9d6 req-d4030ab2-bbc0-4e65-83a2-9cb3f7bd5663 service neutron] 10.222.0.44 "GET /v2.0/networks?id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d HTTP/1.1" status: 200 len: 916 time: 0.1172330 Dec 09 14:43:56.274866 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] Set router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:43:56.276089 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41561b6c-dd36-41c3-90a1-c1e00e67fb75 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d0b22852-f2c4-463d-b9aa-723fddfa7ca7,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:56.294876 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Allocated IP 172.20.0.1 (f0982548-601b-4206-88dc-a16a0317b421/7edf1e5e-d953-4e3c-8dc5-29475e258db2/c3bcca35-88a0-437e-a9e8-3bcbcd962647) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:43:56.348529 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-da374ca1-f030-4641-88ad-3921b0177bae admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:56.409726 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-da374ca1-f030-4641-88ad-3921b0177bae admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:56.495577 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:56.525872 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-da374ca1-f030-4641-88ad-3921b0177bae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:56.528560 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-da374ca1-f030-4641-88ad-3921b0177bae admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:56.529911 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-da374ca1-f030-4641-88ad-3921b0177bae admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/d0b22852-f2c4-463d-b9aa-723fddfa7ca7 HTTP/1.1" status: 204 len: 168 time: 0.3298485 Dec 09 14:43:56.544430 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da374ca1-f030-4641-88ad-3921b0177bae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d0b22852-f2c4-463d-b9aa-723fddfa7ca7,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:56.555832 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:56.611130 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c349e99c-2913-46b8-8b1d-f8299017b9d6 req-2f6be177-216d-4956-99ec-a0ae96cd40bb service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=f52c3419-227a-4edd-add3-ffd3eea75b9d HTTP/1.1" status: 200 len: 217 time: 0.3755953 Dec 09 14:43:56.654378 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Network f0982548-601b-4206-88dc-a16a0317b421 is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:43:56.663347 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:43:56.673294 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:43:56.681049 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Pushing event updated for resources: {'Port': ['ID=c3bcca35-88a0-437e-a9e8-3bcbcd962647,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:56.721742 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:50Z', 'updated_at': '2021-12-09T14:43:52Z', 'revision_number': 3, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'gw_port': {'id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:38:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:51Z', 'updated_at': '2021-12-09T14:43:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:56.722866 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c349e99c-2913-46b8-8b1d-f8299017b9d6 req-2917d899-de69-4a33-9db6-6cc22744f5e2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:56.724375 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c349e99c-2913-46b8-8b1d-f8299017b9d6 req-2917d899-de69-4a33-9db6-6cc22744f5e2 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=7c6b4bb0-bfec-44d0-8503-70917540b3c5 HTTP/1.1" status: 200 len: 855 time: 0.1021166 Dec 09 14:43:56.741811 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1574184'] for router_interface, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:56.768502 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2525a067-7ab2-4097-8322-b14fb119e5bd None None] The sync data for ids ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'] in dv-cinder-819692-8-iscsi is: [{'id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:50Z', 'updated_at': '2021-12-09T14:43:52Z', 'revision_number': 3, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'gw_port': {'id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:38:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:51Z', 'updated_at': '2021-12-09T14:43:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:43:56.814523 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c349e99c-2913-46b8-8b1d-f8299017b9d6 req-2d411d04-94b4-471d-b5d6-ce79a98ce04d service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0604403 Dec 09 14:43:56.895695 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a139cb6-9f38-4772-bcb9-e32ed1b1a7e0 req-13e66572-3695-4850-ba13-9a151ed22991 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:56.897444 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4a139cb6-9f38-4772-bcb9-e32ed1b1a7e0 req-13e66572-3695-4850-ba13-9a151ed22991 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 944 time: 0.1105101 Dec 09 14:43:57.009451 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-64133220-d18d-49d6-9339-d99af6039c5a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:57.036681 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c349e99c-2913-46b8-8b1d-f8299017b9d6 req-0f0c8d17-d1fe-4a7e-8fef-f7ec77e80267 service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2126184 Dec 09 14:43:57.039065 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:57.086881 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4a139cb6-9f38-4772-bcb9-e32ed1b1a7e0 req-df8fbbbb-cf4e-44dd-8ff8-f015570f3b7e tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1518841 Dec 09 14:43:57.110200 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-deb0fefa-7094-4ce7-a5b2-441da1581caa None None] Provisioning complete for port c3bcca35-88a0-437e-a9e8-3bcbcd962647 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:57.110200 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-deb0fefa-7094-4ce7-a5b2-441da1581caa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:57.189822 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-deb0fefa-7094-4ce7-a5b2-441da1581caa None None] Port c3bcca35-88a0-437e-a9e8-3bcbcd962647 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:43:57.193767 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c349e99c-2913-46b8-8b1d-f8299017b9d6 req-c10a7941-20c0-4657-8674-d730398be347 service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1402967 Dec 09 14:43:57.299968 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5d3c0d4-d3e3-4470-b3ff-55ea6f6b462a req-55bef4e3-a014-49bf-a8d4-a7702b8546d4 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:57.312637 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a5d3c0d4-d3e3-4470-b3ff-55ea6f6b462a req-55bef4e3-a014-49bf-a8d4-a7702b8546d4 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0850101 Dec 09 14:43:57.349785 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:57.361201 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-130461426'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:57.375506 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a5d3c0d4-d3e3-4470-b3ff-55ea6f6b462a req-b02776f1-6839-434d-a0df-5089016362d8 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618737 Dec 09 14:43:57.438381 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2066007', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1629368'] for router_interface, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:57.440345 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Pushing event updated for resources: {'Port': ['ID=c3bcca35-88a0-437e-a9e8-3bcbcd962647,revision_number=2']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:57.534869 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Network f0982548-601b-4206-88dc-a16a0317b421 is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:43:57.536303 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:43:57.921173 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-0e8bd1fb-44db-4c10-9ba3-29b8dbba50c1 None None] Provisioning complete for port c3bcca35-88a0-437e-a9e8-3bcbcd962647 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:57.921583 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-0e8bd1fb-44db-4c10-9ba3-29b8dbba50c1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:57.987262 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-0e8bd1fb-44db-4c10-9ba3-29b8dbba50c1 None None] Port c3bcca35-88a0-437e-a9e8-3bcbcd962647 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:43:58.012656 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:43:58.141488 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:43:58.147116 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-b1d3885b-9ca1-479d-a4e0-fd2b87c7634f admin admin] 10.222.0.39 "PUT /v2.0/routers/ff4d224c-d767-4521-9fd6-3bfbaaddfe44/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.3704460 Dec 09 14:43:58.288514 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25b2398a-c9c0-48f0-bdd1-6fea94fa0f5e req-4ddf9e4a-362d-40af-bf32-79657b87d456 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:58.301780 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-25b2398a-c9c0-48f0-bdd1-6fea94fa0f5e req-4ddf9e4a-362d-40af-bf32-79657b87d456 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 944 time: 0.0836887 Dec 09 14:43:58.439232 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-25b2398a-c9c0-48f0-bdd1-6fea94fa0f5e req-95d5c91a-03d3-47f0-8fe0-fba593a810de tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1348300 Dec 09 14:43:58.540555 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57124dc7-c574-4fb1-8bf2-cc2b4ee8c7fc req-d071fc88-d4ff-45d4-9dbc-1f4ca31f5f5a tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:58.542621 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-57124dc7-c574-4fb1-8bf2-cc2b4ee8c7fc req-d071fc88-d4ff-45d4-9dbc-1f4ca31f5f5a tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0650983 Dec 09 14:43:58.619786 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-57124dc7-c574-4fb1-8bf2-cc2b4ee8c7fc req-460a425a-acc2-4330-8c0c-9439c51898df tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644255 Dec 09 14:43:58.763515 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device f52c3419-227a-4edd-add3-ffd3eea75b9d details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:43:58.853908 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Sync routers for ids ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:43:58.863421 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54372) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:58.871571 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1858903589-network', 'tenant_id': 'a8f31f7e517c4112a4fe912ec0af4e73'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:58.888650 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port f52c3419-227a-4edd-add3-ffd3eea75b9d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=f52c3419-227a-4edd-add3-ffd3eea75b9d,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:58.893898 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] Made reservation on behalf of a8f31f7e517c4112a4fe912ec0af4e73 for: {'network': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:43:58.896354 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:58.897596 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Routers {'ff4d224c-d767-4521-9fd6-3bfbaaddfe44'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:43:58.898232 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:43:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:58.927802 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:58.941629 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': 'f52c3419-227a-4edd-add3-ffd3eea75b9d', 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d', 'port_id': 'f52c3419-227a-4edd-add3-ffd3eea75b9d', 'mac_address': 'fa:16:3e:5e:5a:5b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 405, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7c6b4bb0-bfec-44d0-8503-70917540b3c5', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:43:59.080459 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.087375 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.109817 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 419} {{(pid=109062) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:43:59.125961 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=64df9bd4-83c7-4f5b-9929-5705e5ed105a,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:59.131522 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.131892 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.segments_db [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] Added segment 5ff332d6-98f0-4e32-b597-ce3b7eef375d of type vlan for network edca1021-fd9b-45bb-ba78-6e98cb142620 Dec 09 14:43:59.176089 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.177019 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device d811a33d-c420-4cb6-9ca9-cc0a9c770df5 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:43:59.209899 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.211074 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:59.212102 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.221904 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.247454 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-802950ce-4bdd-4ad2-9134-27926a1c9af6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.267823 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Set router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:43:59.269357 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4047391 Dec 09 14:43:59.270454 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f52c3419-227a-4edd-add3-ffd3eea75b9d {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:43:59.272240 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 54388) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:59.278202 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-64e8050e-c19d-4431-9ba8-5260f677b300 admin admin] Request body: {'subnet': {'network_id': 'edca1021-fd9b-45bb-ba78-6e98cb142620', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1858903589-subnet', 'tenant_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'ip_version': 4}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:59.284885 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f6610ce-42af-4e5c-b091-f5c00c7e51c2 admin admin] Pushing event updated for resources: {'Network': ['ID=edca1021-fd9b-45bb-ba78-6e98cb142620,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:59.301107 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-64e8050e-c19d-4431-9ba8-5260f677b300 admin admin] Made reservation on behalf of a8f31f7e517c4112a4fe912ec0af4e73 for: {'subnet': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:43:59.303792 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-64e8050e-c19d-4431-9ba8-5260f677b300 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-133483919'] for subnet, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.310850 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network edca1021-fd9b-45bb-ba78-6e98cb142620 details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:43:59.383014 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port f52c3419-227a-4edd-add3-ffd3eea75b9d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=f52c3419-227a-4edd-add3-ffd3eea75b9d,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:59.425058 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.517965 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-64e8050e-c19d-4431-9ba8-5260f677b300 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-133412248', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-133640805'] for subnet, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.530084 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port d811a33d-c420-4cb6-9ca9-cc0a9c770df5 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:43:59.530504 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.592942 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=f52c3419-227a-4edd-add3-ffd3eea75b9d,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:59.612882 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64e8050e-c19d-4431-9ba8-5260f677b300 admin admin] Pushing event updated for resources: {'Subnet': ['ID=63f5a977-675b-413c-a956-3d5e00291d6e,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:43:59.628838 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64e8050e-c19d-4431-9ba8-5260f677b300 admin admin] Checking segment: {'id': '5ff332d6-98f0-4e32-b597-ce3b7eef375d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'edca1021-fd9b-45bb-ba78-6e98cb142620'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:43:59.630873 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64e8050e-c19d-4431-9ba8-5260f677b300 admin admin] Network hostable DHCP agents. Network: edca1021-fd9b-45bb-ba78-6e98cb142620, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109061) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:43:59.658883 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64e8050e-c19d-4431-9ba8-5260f677b300 admin admin] Network edca1021-fd9b-45bb-ba78-6e98cb142620 is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109061) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:43:59.673268 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-64e8050e-c19d-4431-9ba8-5260f677b300 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, edca1021-fd9b-45bb-ba78-6e98cb142620) {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:43:59.680591 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ef834b5-3c4f-4948-8392-145df45a3209 req-c71a4f27-a7ec-464a-b2d2-82344c1a92b0 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:59.682865 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-64e8050e-c19d-4431-9ba8-5260f677b300 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:59.683430 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4ef834b5-3c4f-4948-8392-145df45a3209 req-c71a4f27-a7ec-464a-b2d2-82344c1a92b0 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 945 time: 0.1536448 Dec 09 14:43:59.691169 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-64e8050e-c19d-4431-9ba8-5260f677b300 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.700876 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8d505560-c7ea-4be7-b7ed-1deb109ccd0c None None] Network edca1021-fd9b-45bb-ba78-6e98cb142620 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:43:59.752454 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-64e8050e-c19d-4431-9ba8-5260f677b300 admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.4790239 Dec 09 14:43:59.764409 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 54416) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:43:59.774825 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1858903589-router', 'tenant_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:43:59.775682 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4ef834b5-3c4f-4948-8392-145df45a3209 req-3ef9ae21-6672-4de7-99c9-a5992509bc73 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0853691 Dec 09 14:43:59.790300 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.839984 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53c87ee8-e1c9-496b-a332-381239ad12cd req-443c25e7-b504-4742-8279-14c33b94ed31 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:43:59.848442 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-53c87ee8-e1c9-496b-a332-381239ad12cd req-443c25e7-b504-4742-8279-14c33b94ed31 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0944295 Dec 09 14:43:59.852610 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['f52c3419-227a-4edd-add3-ffd3eea75b9d'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:43:59.859073 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1626853', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30590'] for router, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.860535 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1626745', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1584168', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1653733', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30569'] for router, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:43:59.900600 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] For port d811a33d-c420-4cb6-9ca9-cc0a9c770df5, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=d811a33d-c420-4cb6-9ca9-cc0a9c770df5,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:43:59.921081 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-53c87ee8-e1c9-496b-a332-381239ad12cd req-7a09dede-26cc-4137-a2b3-145560165e18 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0660264 Dec 09 14:43:59.930326 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:50Z', 'updated_at': '2021-12-09T14:43:56Z', 'revision_number': 4, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'gw_port': {'id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:38:3d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:51Z', 'updated_at': '2021-12-09T14:43:56Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'c3bcca35-88a0-437e-a9e8-3bcbcd962647', 'name': '', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'mac_address': 'fa:16:3e:97:bd:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_interface', 'standard_attr_id': 277, 'fixed_ips': [{'subnet_id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:55Z', 'updated_at': '2021-12-09T14:43:57Z', 'revision_number': 2, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'subnets': [{'id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:43:59.972594 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Checking router: ff4d224c-d767-4521-9fd6-3bfbaaddfe44 for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:43:59.973530 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Updating router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 port c3bcca35-88a0-437e-a9e8-3bcbcd962647 binding host dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:44:00.000996 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.017189 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.027971 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.085139 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp191c2114-7e35-566a-a422-2a0bb50a5442-edca1021-fd9b-45bb-ba78-6e98cb142620', 'network_id': 'edca1021-fd9b-45bb-ba78-6e98cb142620', 'project_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'fixed_ips': [{'subnet_id': '63f5a977-675b-413c-a956-3d5e00291d6e'}]}} from dv-cinder-819692-8-iscsi. {{(pid=109063) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 14:44:00.085857 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.153745 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Pushing event updated for resources: {'Port': ['ID=d811a33d-c420-4cb6-9ca9-cc0a9c770df5,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:00.226443 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.397740 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54446) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:00.464646 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54450) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:00.512306 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.523534 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.db_base_plugin_common [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Allocated IP 172.20.0.2 (edca1021-fd9b-45bb-ba78-6e98cb142620/63f5a977-675b-413c-a956-3d5e00291d6e/3e85441c-aef7-4129-abc7-1c08d1066a30) {{(pid=109063) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:44:00.529690 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.558106 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.583146 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1c2d97ec-84b4-4a17-baec-b39326e1d92f admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.623078 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0de8b6f4-33af-42df-8156-736ab58c548f admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.680639 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Allocated IP 172.27.0.142 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/008db50f-29f1-4f8e-adfc-3ae8286f02d5) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:44:00.722380 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Publish callbacks [] for port, precommit_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.731417 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1c2d97ec-84b4-4a17-baec-b39326e1d92f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.743350 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1c2d97ec-84b4-4a17-baec-b39326e1d92f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.747085 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0de8b6f4-33af-42df-8156-736ab58c548f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.753184 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.768458 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0de8b6f4-33af-42df-8156-736ab58c548f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.795283 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c2d97ec-84b4-4a17-baec-b39326e1d92f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=53e9af00-dc7e-449a-afa2-577a75252980,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:00.813587 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Publish callbacks [] for port, precommit_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.815963 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.831195 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 54456) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:00.833052 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-1c2d97ec-84b4-4a17-baec-b39326e1d92f admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=23b0a7784333402b9be62bfff5bf7fb0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4334912 Dec 09 14:44:00.849299 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a7ef6c5-f501-4e4c-8d74-7872ce3a5c97 None None] Pushing event updated for resources: {'Port': ['ID=c3bcca35-88a0-437e-a9e8-3bcbcd962647,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:00.852133 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.869517 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-0de8b6f4-33af-42df-8156-736ab58c548f admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=7a70e2359fcc4a3bb2b92023a1ca7e69&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4007468 Dec 09 14:44:00.870676 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 54458) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:00.890843 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0de8b6f4-33af-42df-8156-736ab58c548f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=27c790fb-e148-4fc7-976b-1d547e36efda,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:00.917206 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Attempting to bind port c3bcca35-88a0-437e-a9e8-3bcbcd962647 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:44:00.917769 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Attempting to bind port c3bcca35-88a0-437e-a9e8-3bcbcd962647 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'a2b92707-4465-4444-9285-42fd2c8881e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:44:00.918304 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Attempting to bind port c3bcca35-88a0-437e-a9e8-3bcbcd962647 on network f0982548-601b-4206-88dc-a16a0317b421 {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:44:00.930089 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 43, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:44:00.930755 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Checking segment: {'id': 'a2b92707-4465-4444-9285-42fd2c8881e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:44:00.931415 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.932028 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Bound using segment: {'id': 'a2b92707-4465-4444-9285-42fd2c8881e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:44:00.932694 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Bound port: c3bcca35-88a0-437e-a9e8-3bcbcd962647, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a2b92707-4465-4444-9285-42fd2c8881e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:44:00.933291 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.946954 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ffcc5353-bd84-415e-8801-288f1df89984 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.950305 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Network edca1021-fd9b-45bb-ba78-6e98cb142620 is already hosted by enough agents. {{(pid=109063) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:44:00.961006 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.base_scheduler [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Resources bound (agent type, host, resource id): {{(pid=109063) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:44:00.965397 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Received port after_create {{(pid=109063) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:44:00.966889 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:00.973984 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eb96314-85dd-40ca-98cb-76b3c34ce65f req-c4ef2dc9-f62f-4468-b6db-bed8d8242234 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:00.978108 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4eb96314-85dd-40ca-98cb-76b3c34ce65f req-c4ef2dc9-f62f-4468-b6db-bed8d8242234 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 945 time: 0.0822320 Dec 09 14:44:01.016402 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Pushing event updated for resources: {'Port': ['ID=3e85441c-aef7-4129-abc7-1c08d1066a30,revision_number=1']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:01.038448 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Pushing event updated for resources: {'Port': ['ID=008db50f-29f1-4f8e-adfc-3ae8286f02d5,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:01.057334 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:44:01.062567 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ffcc5353-bd84-415e-8801-288f1df89984 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.081143 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4eb96314-85dd-40ca-98cb-76b3c34ce65f req-d2d8ffbd-beb1-49d9-ae0c-7fbd1fb7d9fe tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0966771 Dec 09 14:44:01.093723 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-9aa73644-061f-4f68-977a-8d28d8b24946 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.095695 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:44:01.117582 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:44:01.192916 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-9aa73644-061f-4f68-977a-8d28d8b24946 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.211638 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a461115f-79e8-4d90-9113-7f0e9fc9ab9f req-d8ca5f6e-291e-48ee-a42e-7809cb7fd098 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:01.213237 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a461115f-79e8-4d90-9113-7f0e9fc9ab9f req-d8ca5f6e-291e-48ee-a42e-7809cb7fd098 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.1547935 Dec 09 14:44:01.224315 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device d811a33d-c420-4cb6-9ca9-cc0a9c770df5 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:44:01.286267 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Attempting to bind port 3e85441c-aef7-4129-abc7-1c08d1066a30 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:44:01.286627 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Attempting to bind port 3e85441c-aef7-4129-abc7-1c08d1066a30 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': '5ff332d6-98f0-4e32-b597-ce3b7eef375d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'edca1021-fd9b-45bb-ba78-6e98cb142620'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:44:01.287023 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Attempting to bind port 3e85441c-aef7-4129-abc7-1c08d1066a30 on network edca1021-fd9b-45bb-ba78-6e98cb142620 {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:44:01.306178 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 43, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:44:01.306565 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Checking segment: {'id': '5ff332d6-98f0-4e32-b597-ce3b7eef375d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'edca1021-fd9b-45bb-ba78-6e98cb142620'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:44:01.306973 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.307373 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Bound using segment: {'id': '5ff332d6-98f0-4e32-b597-ce3b7eef375d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'edca1021-fd9b-45bb-ba78-6e98cb142620'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:44:01.307896 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Bound port: 3e85441c-aef7-4129-abc7-1c08d1066a30, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5ff332d6-98f0-4e32-b597-ce3b7eef375d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'edca1021-fd9b-45bb-ba78-6e98cb142620'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:44:01.308291 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.312478 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] For port c3bcca35-88a0-437e-a9e8-3bcbcd962647, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:44:01.320822 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-2d909251-7c8d-4876-bfc3-759b15f8cbf5 None None] Provisioning complete for port c3bcca35-88a0-437e-a9e8-3bcbcd962647 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:01.321192 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-2d909251-7c8d-4876-bfc3-759b15f8cbf5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.363282 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] For port c3bcca35-88a0-437e-a9e8-3bcbcd962647, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=c3bcca35-88a0-437e-a9e8-3bcbcd962647,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:44:01.375344 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ffcc5353-bd84-415e-8801-288f1df89984 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.377951 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ffcc5353-bd84-415e-8801-288f1df89984 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.379188 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-ffcc5353-bd84-415e-8801-288f1df89984 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/53e9af00-dc7e-449a-afa2-577a75252980 HTTP/1.1" status: 204 len: 168 time: 0.5468402 Dec 09 14:44:01.391626 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.406857 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a461115f-79e8-4d90-9113-7f0e9fc9ab9f req-bcf1a516-d649-4738-822a-669cb45dd54a tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1760490 Dec 09 14:44:01.408523 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-2d909251-7c8d-4876-bfc3-759b15f8cbf5 None None] Port c3bcca35-88a0-437e-a9e8-3bcbcd962647 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:44:01.413434 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ffcc5353-bd84-415e-8801-288f1df89984 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=53e9af00-dc7e-449a-afa2-577a75252980,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:01.449468 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-9aa73644-061f-4f68-977a-8d28d8b24946 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.452799 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-9aa73644-061f-4f68-977a-8d28d8b24946 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.454432 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port d811a33d-c420-4cb6-9ca9-cc0a9c770df5 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:01.454813 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.458766 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-9aa73644-061f-4f68-977a-8d28d8b24946 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/27c790fb-e148-4fc7-976b-1d547e36efda HTTP/1.1" status: 204 len: 168 time: 0.5816844 Dec 09 14:44:01.546283 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9aa73644-061f-4f68-977a-8d28d8b24946 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=27c790fb-e148-4fc7-976b-1d547e36efda,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:01.566349 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] For port 3e85441c-aef7-4129-abc7-1c08d1066a30, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:44:01.589509 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a7ef6c5-f501-4e4c-8d74-7872ce3a5c97 None None] Pushing event updated for resources: {'Port': ['ID=c3bcca35-88a0-437e-a9e8-3bcbcd962647,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:01.592337 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Routers {'ff4d224c-d767-4521-9fd6-3bfbaaddfe44'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:44:01.592966 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:43:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:44:01.626981 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] For port 3e85441c-aef7-4129-abc7-1c08d1066a30, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=3e85441c-aef7-4129-abc7-1c08d1066a30,segment=NetworkSegment(5ff332d6-98f0-4e32-b597-ce3b7eef375d),segment_id=5ff332d6-98f0-4e32-b597-ce3b7eef375d)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:44:01.667437 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.682759 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.896826 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95af1e61-205c-4ee1-9d0c-10994c9cbab4 None None] Pushing event updated for resources: {'Port': ['ID=3e85441c-aef7-4129-abc7-1c08d1066a30,revision_number=2']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:01.910104 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.935258 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] Set router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:44:01.968375 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1626736', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1574391'] for router, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:01.973377 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-dfeb3e84-4d3e-46bd-b54e-ad95d9d638c9 None None] Provisioning complete for port c3bcca35-88a0-437e-a9e8-3bcbcd962647 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:01.974127 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-dfeb3e84-4d3e-46bd-b54e-ad95d9d638c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:02.108014 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54490) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:02.131448 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c6d64ccc-dfe9-454d-8fc7-1d96a36e3bcc admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:02.264644 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-dfeb3e84-4d3e-46bd-b54e-ad95d9d638c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:02.268406 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Router 7ee633f5-6fc0-47fb-b142-36d2466f7abd is scheduled to L3 agent d9048829-2654-4d94-83cc-155a0884505e with binding_index 1 {{(pid=109061) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 14:44:02.331852 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c6d64ccc-dfe9-454d-8fc7-1d96a36e3bcc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:02.337020 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-dfeb3e84-4d3e-46bd-b54e-ad95d9d638c9 None None] For port c3bcca35-88a0-437e-a9e8-3bcbcd962647, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=c3bcca35-88a0-437e-a9e8-3bcbcd962647,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:02.341710 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c6d64ccc-dfe9-454d-8fc7-1d96a36e3bcc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:02.350100 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-dfeb3e84-4d3e-46bd-b54e-ad95d9d638c9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:02.385041 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-c6d64ccc-dfe9-454d-8fc7-1d96a36e3bcc admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=d2fb61a67f8b4c86bdc5179e51acf227&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2757578 Dec 09 14:44:02.387502 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54498) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:02.398264 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:50Z', 'updated_at': '2021-12-09T14:43:56Z', 'revision_number': 4, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'gw_port': {'id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:38:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:51Z', 'updated_at': '2021-12-09T14:43:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'c3bcca35-88a0-437e-a9e8-3bcbcd962647', 'name': '', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'mac_address': 'fa:16:3e:97:bd:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_interface', 'standard_attr_id': 277, 'fixed_ips': [{'subnet_id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:55Z', 'updated_at': '2021-12-09T14:44:01Z', 'revision_number': 4, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'subnets': [{'id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:44:02.402881 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:44:02.412334 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Sync routers for ids ['7ee633f5-6fc0-47fb-b142-36d2466f7abd'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:44:02.429895 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:02.430448 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Routers {'7ee633f5-6fc0-47fb-b142-36d2466f7abd'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:44:02.433463 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-65aad957-f577-41e5-b66b-a3455755d90c admin admin] 10.222.0.39 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 2.6643722 Dec 09 14:44:02.435534 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 54502) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:02.436249 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:43:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['7ee633f5-6fc0-47fb-b142-36d2466f7abd'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:44:02.469395 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8807ed78-fa81-4aa5-97ef-bbba7f68f046 req-cf75fc8f-282f-495f-9b2f-5f0735e251ec tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:02.477626 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8807ed78-fa81-4aa5-97ef-bbba7f68f046 req-cf75fc8f-282f-495f-9b2f-5f0735e251ec tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 945 time: 0.2680264 Dec 09 14:44:02.495892 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6d64ccc-dfe9-454d-8fc7-1d96a36e3bcc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c4b259a-2bba-4f3e-85e5-7f4a2f682c0f,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:02.499366 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f9f00ffb-7534-40cd-b9cf-e9ef82ba8cf4 None None] The sync data for ids ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'] in dv-cinder-819692-8-iscsi is: [{'id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:50Z', 'updated_at': '2021-12-09T14:43:56Z', 'revision_number': 4, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'gw_port': {'id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:38:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:51Z', 'updated_at': '2021-12-09T14:43:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'c3bcca35-88a0-437e-a9e8-3bcbcd962647', 'name': '', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'mac_address': 'fa:16:3e:97:bd:b5', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_interface', 'standard_attr_id': 277, 'fixed_ips': [{'subnet_id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:55Z', 'updated_at': '2021-12-09T14:44:01Z', 'revision_number': 4, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'subnets': [{'id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:44:02.536838 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfeb3e84-4d3e-46bd-b54e-ad95d9d638c9 None None] Pushing event updated for resources: {'Port': ['ID=c3bcca35-88a0-437e-a9e8-3bcbcd962647,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:02.613944 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4470c089-47de-4eb2-a422-c23780fec0bb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:02.637624 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:02.665145 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4470c089-47de-4eb2-a422-c23780fec0bb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:02.714415 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Set router 7ee633f5-6fc0-47fb-b142-36d2466f7abd gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:44:02.766625 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device f52c3419-227a-4edd-add3-ffd3eea75b9d up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:44:02.848595 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8807ed78-fa81-4aa5-97ef-bbba7f68f046 req-deb877c4-bd4d-4a64-b7f8-a08984c1a75b tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3695233 Dec 09 14:44:02.866969 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4470c089-47de-4eb2-a422-c23780fec0bb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:02.871536 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4470c089-47de-4eb2-a422-c23780fec0bb admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:02.892388 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port f52c3419-227a-4edd-add3-ffd3eea75b9d completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:44:02.893656 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-4470c089-47de-4eb2-a422-c23780fec0bb admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/1c4b259a-2bba-4f3e-85e5-7f4a2f682c0f HTTP/1.1" status: 204 len: 168 time: 0.4799409 Dec 09 14:44:02.897214 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port f52c3419-227a-4edd-add3-ffd3eea75b9d triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:02.897795 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:02.924487 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8edfec1-690e-47b8-b5db-a8b49de6765d req-b9910a42-c608-49e0-953e-61e96a10f648 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:02.931097 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a8edfec1-690e-47b8-b5db-a8b49de6765d req-b9910a42-c608-49e0-953e-61e96a10f648 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.2669051 Dec 09 14:44:02.937746 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4470c089-47de-4eb2-a422-c23780fec0bb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c4b259a-2bba-4f3e-85e5-7f4a2f682c0f,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:03.179709 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:03.278683 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '151740c8-abee-4794-ae76-20ebd9c216c8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f52c3419-227a-4edd-add3-ffd3eea75b9d'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:44:03.282584 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3c7d93a4-3880-4c66-bbee-19f424e3b942" -d '{"events": [{"server_uuid": "151740c8-abee-4794-ae76-20ebd9c216c8", "name": "network-vif-plugged", "status": "completed", "tag": "f52c3419-227a-4edd-add3-ffd3eea75b9d"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:44:03.283770 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'name': 'tempest-TestShelveInstance-1858903589-router', 'tenant_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.142'}], 'enable_snat': True}, 'gw_port_id': '008db50f-29f1-4f8e-adfc-3ae8286f02d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:59Z', 'updated_at': '2021-12-09T14:44:01Z', 'revision_number': 3, 'project_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'gw_port': {'id': '008db50f-29f1-4f8e-adfc-3ae8286f02d5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:73:75:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:44:00Z', 'updated_at': '2021-12-09T14:44:00Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:44:03.290744 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device c3bcca35-88a0-437e-a9e8-3bcbcd962647 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:44:03.346378 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a8edfec1-690e-47b8-b5db-a8b49de6765d req-dae44451-d784-4128-9fd3-bf5d780ba010 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3392844 Dec 09 14:44:03.354506 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Checking router: 7ee633f5-6fc0-47fb-b142-36d2466f7abd for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:44:03.354745 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Updating router 7ee633f5-6fc0-47fb-b142-36d2466f7abd port 008db50f-29f1-4f8e-adfc-3ae8286f02d5 binding host dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:44:03.394986 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:03.396535 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port f52c3419-227a-4edd-add3-ffd3eea75b9d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=f52c3419-227a-4edd-add3-ffd3eea75b9d,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:03.406034 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:44:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e8c3522e-2bcd-4352-8628-ef0e2f46e67a x-openstack-request-id: req-e8c3522e-2bcd-4352-8628-ef0e2f46e67a {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:44:03.408319 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "151740c8-abee-4794-ae76-20ebd9c216c8", "name": "network-vif-plugged", "status": "completed", "tag": "f52c3419-227a-4edd-add3-ffd3eea75b9d", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:44:03.408750 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-e8c3522e-2bcd-4352-8628-ef0e2f46e67a {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:44:03.409334 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '151740c8-abee-4794-ae76-20ebd9c216c8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f52c3419-227a-4edd-add3-ffd3eea75b9d', 'code': 200} Dec 09 14:44:03.420020 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:03.445499 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:44:03.447989 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9076945-7f82-4ada-bcc8-af05124cdc81 None None] Network edca1021-fd9b-45bb-ba78-6e98cb142620 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:44:03.773542 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=f52c3419-227a-4edd-add3-ffd3eea75b9d,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:03.793440 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-88144583-9045-45cf-8b90-03e0bc1a0f74 None None] Provisioning complete for port 3e85441c-aef7-4129-abc7-1c08d1066a30 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:03.793951 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-88144583-9045-45cf-8b90-03e0bc1a0f74 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:03.812603 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:03.838731 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port c3bcca35-88a0-437e-a9e8-3bcbcd962647 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:03.839190 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:03.857630 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a282634d-ce68-4e9b-b33f-aff319bf1d88 req-11d8b411-a87d-4cf7-9e8c-b91f049e434c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:03.859211 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a282634d-ce68-4e9b-b33f-aff319bf1d88 req-11d8b411-a87d-4cf7-9e8c-b91f049e434c service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 1099 time: 0.1758971 Dec 09 14:44:04.074392 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a282634d-ce68-4e9b-b33f-aff319bf1d88 req-c0f674b5-563a-4949-a3c3-bd609f1ef69e service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1725314 Dec 09 14:44:04.093328 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Publish callbacks [] for port, precommit_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:04.105880 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:04.149181 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cdd5ad3-bdb4-4a6f-a158-a435f23655fb req-c942b5ef-15ae-4f84-89c0-cdadaa916703 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:04.150777 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5cdd5ad3-bdb4-4a6f-a158-a435f23655fb req-c942b5ef-15ae-4f84-89c0-cdadaa916703 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 946 time: 0.1490421 Dec 09 14:44:04.190746 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-88144583-9045-45cf-8b90-03e0bc1a0f74 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:04.195569 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 3e85441c-aef7-4129-abc7-1c08d1066a30 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:44:04.202907 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Allocated IP 172.20.0.1 (edca1021-fd9b-45bb-ba78-6e98cb142620/63f5a977-675b-413c-a956-3d5e00291d6e/91495d3d-92f1-40a0-8137-14990e8f3b6f) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:44:04.254745 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e71f8ae1-df41-4fe3-a0a3-43ba4f0877d9 None None] Pushing event updated for resources: {'Port': ['ID=008db50f-29f1-4f8e-adfc-3ae8286f02d5,revision_number=2']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:04.297081 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Attempting to bind port 008db50f-29f1-4f8e-adfc-3ae8286f02d5 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:44:04.297641 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Attempting to bind port 008db50f-29f1-4f8e-adfc-3ae8286f02d5 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:44:04.299892 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Attempting to bind port 008db50f-29f1-4f8e-adfc-3ae8286f02d5 on network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:44:04.318746 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 44, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:44:04.319451 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Checking segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109064) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:44:04.319567 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 3e85441c-aef7-4129-abc7-1c08d1066a30 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:04.319967 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:04.320409 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:04.321220 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Bound using segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:44:04.322243 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Bound port: 008db50f-29f1-4f8e-adfc-3ae8286f02d5, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:44:04.325151 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:04.339533 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-88144583-9045-45cf-8b90-03e0bc1a0f74 None None] For port 3e85441c-aef7-4129-abc7-1c08d1066a30, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=3e85441c-aef7-4129-abc7-1c08d1066a30,segment=NetworkSegment(5ff332d6-98f0-4e32-b597-ce3b7eef375d),segment_id=5ff332d6-98f0-4e32-b597-ce3b7eef375d)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:04.363836 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-88144583-9045-45cf-8b90-03e0bc1a0f74 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:04.472838 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88144583-9045-45cf-8b90-03e0bc1a0f74 None None] Pushing event updated for resources: {'Port': ['ID=3e85441c-aef7-4129-abc7-1c08d1066a30,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:04.491844 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] For port 008db50f-29f1-4f8e-adfc-3ae8286f02d5, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109064) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:44:04.512591 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] For port 008db50f-29f1-4f8e-adfc-3ae8286f02d5, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=008db50f-29f1-4f8e-adfc-3ae8286f02d5,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109064) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:44:04.521070 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5ce14622-629e-4a50-90fe-5f644ebadafc None None] Provisioning complete for port 3e85441c-aef7-4129-abc7-1c08d1066a30 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:04.521799 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5ce14622-629e-4a50-90fe-5f644ebadafc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:04.527383 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:04.577099 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b22c122-6082-43dc-a05e-2390e2e9f79a req-86c42491-b15e-462c-a944-7cc7f6937143 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:04.579790 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4b22c122-6082-43dc-a05e-2390e2e9f79a req-86c42491-b15e-462c-a944-7cc7f6937143 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0829561 Dec 09 14:44:04.661296 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e71f8ae1-df41-4fe3-a0a3-43ba4f0877d9 None None] Pushing event updated for resources: {'Port': ['ID=008db50f-29f1-4f8e-adfc-3ae8286f02d5,revision_number=3']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:04.692802 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4b22c122-6082-43dc-a05e-2390e2e9f79a req-df1f5708-bee8-464f-b820-12512c957f73 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1030424 Dec 09 14:44:04.719025 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Routers {'7ee633f5-6fc0-47fb-b142-36d2466f7abd'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:44:04.722621 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:43:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['7ee633f5-6fc0-47fb-b142-36d2466f7abd'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:44:04.790001 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5cdd5ad3-bdb4-4a6f-a158-a435f23655fb req-0b2f5ecf-253d-40d3-b8d8-1ad3ee3d4f6e tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6322761 Dec 09 14:44:04.904396 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:04.918691 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] Set router 7ee633f5-6fc0-47fb-b142-36d2466f7abd gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:44:05.006932 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:05.040261 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 3e85441c-aef7-4129-abc7-1c08d1066a30 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:44:05.061808 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Network edca1021-fd9b-45bb-ba78-6e98cb142620 is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:44:05.063270 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:44:05.067280 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:44:05.090464 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-bf4b6044-36c3-49c0-a751-0d8ea3f2f47c tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/networks?tenant_id=8d276344db394d60b4fc283713bf252e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0463071 Dec 09 14:44:05.127569 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Pushing event updated for resources: {'Port': ['ID=91495d3d-92f1-40a0-8137-14990e8f3b6f,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:05.146505 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 3e85441c-aef7-4129-abc7-1c08d1066a30 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:05.146886 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:05.152038 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1574184'] for router_interface, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:05.201397 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'name': 'tempest-TestShelveInstance-1858903589-router', 'tenant_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.142'}], 'enable_snat': True}, 'gw_port_id': '008db50f-29f1-4f8e-adfc-3ae8286f02d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:59Z', 'updated_at': '2021-12-09T14:44:01Z', 'revision_number': 3, 'project_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'gw_port': {'id': '008db50f-29f1-4f8e-adfc-3ae8286f02d5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:73:75:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:44:00Z', 'updated_at': '2021-12-09T14:44:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:44:05.252489 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8bfa4e0-f950-42c5-b446-1d62c90ff30b None None] The sync data for ids ['7ee633f5-6fc0-47fb-b142-36d2466f7abd'] in dv-cinder-819692-8-iscsi is: [{'id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'name': 'tempest-TestShelveInstance-1858903589-router', 'tenant_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.142'}], 'enable_snat': True}, 'gw_port_id': '008db50f-29f1-4f8e-adfc-3ae8286f02d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:59Z', 'updated_at': '2021-12-09T14:44:01Z', 'revision_number': 3, 'project_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'gw_port': {'id': '008db50f-29f1-4f8e-adfc-3ae8286f02d5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:73:75:4a', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:44:00Z', 'updated_at': '2021-12-09T14:44:04Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:44:05.413783 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:05.461677 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-95c7f396-d9e4-4172-be75-d073b9f2a40d None None] Provisioning complete for port 91495d3d-92f1-40a0-8137-14990e8f3b6f triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:05.462304 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-95c7f396-d9e4-4172-be75-d073b9f2a40d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:05.509990 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-13df7ffd-a939-4cd0-afdf-108f678f32d8 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:05.518703 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-13df7ffd-a939-4cd0-afdf-108f678f32d8 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.4269271 Dec 09 14:44:05.557580 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-5be1b66b-6e79-452c-82cd-64f3ceb41ac6 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/quotas/8d276344db394d60b4fc283713bf252e HTTP/1.1" status: 200 len: 375 time: 0.0377123 Dec 09 14:44:05.617596 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-95c7f396-d9e4-4172-be75-d073b9f2a40d None None] Port 91495d3d-92f1-40a0-8137-14990e8f3b6f cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:44:05.629980 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-abb72da3-eb7a-4e18-ae36-8fc32a2f7824 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=8d276344db394d60b4fc283713bf252e&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0697351 Dec 09 14:44:05.789810 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:05.799841 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:05.846587 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1cc51fdd-6bf4-4adf-82dd-390f7647978d req-9f7ba6bd-5e2a-4ccf-97d1-39c52a929d8c tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 210 time: 0.0371792 Dec 09 14:44:05.892785 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2066007', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1629368'] for router_interface, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:05.985767 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-248fb6fb-180f-4f28-b624-9e43f3156782 req-ae38c6d0-2110-48fa-b961-4e41b826efb1 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:05.987289 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-248fb6fb-180f-4f28-b624-9e43f3156782 req-ae38c6d0-2110-48fa-b961-4e41b826efb1 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 946 time: 0.0731866 Dec 09 14:44:06.014025 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Pushing event updated for resources: {'Port': ['ID=91495d3d-92f1-40a0-8137-14990e8f3b6f,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:06.048076 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-472a9652-32dd-43dc-ad7d-db99ad733810 req-c06c800f-3104-4660-aa15-4d5e012ac3aa tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:06.049883 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-472a9652-32dd-43dc-ad7d-db99ad733810 req-c06c800f-3104-4660-aa15-4d5e012ac3aa tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.1988201 Dec 09 14:44:06.063675 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-248fb6fb-180f-4f28-b624-9e43f3156782 req-78d30921-b4ab-497b-9c86-f7f21beb8728 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0621290 Dec 09 14:44:06.203598 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-472a9652-32dd-43dc-ad7d-db99ad733810 req-4708cf4a-d3e0-4ca0-85de-2e834b194c36 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1436939 Dec 09 14:44:06.205967 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Network edca1021-fd9b-45bb-ba78-6e98cb142620 is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:44:06.207936 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:44:06.435330 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Router 7ee633f5-6fc0-47fb-b142-36d2466f7abd has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:44:06.600458 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:44:06.607026 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-dc167fec-9904-4a2d-aa7b-55e017433ed7 admin admin] 10.222.0.39 "PUT /v2.0/routers/7ee633f5-6fc0-47fb-b142-36d2466f7abd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.1676226 Dec 09 14:44:06.662391 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-6b7eb1a6-f4f5-4573-a3e6-c1231498bd3b None None] Provisioning complete for port 91495d3d-92f1-40a0-8137-14990e8f3b6f triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:06.663020 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-6b7eb1a6-f4f5-4573-a3e6-c1231498bd3b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:06.750916 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-6b7eb1a6-f4f5-4573-a3e6-c1231498bd3b None None] Port 91495d3d-92f1-40a0-8137-14990e8f3b6f cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:44:07.048415 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-09de30cc-ba25-4179-a2c5-edcdbf61e530 req-dd80e39d-de41-4ac3-ae1b-89d1b8a5af4c tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 210 time: 0.0630627 Dec 09 14:44:07.087701 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 008db50f-29f1-4f8e-adfc-3ae8286f02d5 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:44:07.143087 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 008db50f-29f1-4f8e-adfc-3ae8286f02d5 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:07.143636 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:07.247338 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:07.278055 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] For port 008db50f-29f1-4f8e-adfc-3ae8286f02d5, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=008db50f-29f1-4f8e-adfc-3ae8286f02d5,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:07.284559 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:07.354666 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Pushing event updated for resources: {'Port': ['ID=008db50f-29f1-4f8e-adfc-3ae8286f02d5,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:07.371116 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 54690) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:07.377167 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-ebcf1c19-c680-4a32-bf95-d862c9bdaf88 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-999339417', 'description': 'tempest-secgroup-smoke-999339417 description', 'project_id': '10d73d0acf44499e88f6d53847b2094e'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:07.516322 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-f321eab5-fdea-4184-8c7b-0fb4d6faa58c tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.44 "GET /v2.0/networks?tenant_id=8d276344db394d60b4fc283713bf252e&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1213486 Dec 09 14:44:07.524747 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ebcf1c19-c680-4a32-bf95-d862c9bdaf88 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:07.527597 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c64e173-c4c6-4426-bd82-40550125af2c req-1a0da809-a1a4-4a3d-a3d1-9d13a49df209 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:07.529295 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4c64e173-c4c6-4426-bd82-40550125af2c req-1a0da809-a1a4-4a3d-a3d1-9d13a49df209 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.1105206 Dec 09 14:44:07.588919 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4c64e173-c4c6-4426-bd82-40550125af2c req-7872640b-7bf9-4622-b7c1-5ef5595bf3a1 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517061 Dec 09 14:44:07.748178 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Sync routers for ids ['7ee633f5-6fc0-47fb-b142-36d2466f7abd'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:44:07.758402 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Routers {'7ee633f5-6fc0-47fb-b142-36d2466f7abd'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:44:07.759024 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:43:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['7ee633f5-6fc0-47fb-b142-36d2466f7abd'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:44:07.829675 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-bd792652-57ae-437a-91b2-aeb69a2c64bc tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:07.831209 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-bd792652-57ae-437a-91b2-aeb69a2c64bc tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.44 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2978158 Dec 09 14:44:07.856282 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Request body: {'port': {'device_id': '9c22cb81-5912-4c52-933a-aba88e03e404', 'network_id': '11abbada-ef44-4275-ad88-90374a31e950', 'admin_state_up': True, 'tenant_id': '8d276344db394d60b4fc283713bf252e'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:07.875689 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Set router 7ee633f5-6fc0-47fb-b142-36d2466f7abd gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:44:07.876455 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ebcf1c19-c680-4a32-bf95-d862c9bdaf88 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:07.908372 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ebcf1c19-c680-4a32-bf95-d862c9bdaf88 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:07.957699 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ebcf1c19-c680-4a32-bf95-d862c9bdaf88 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:07.961912 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-ebcf1c19-c680-4a32-bf95-d862c9bdaf88 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.5861521 Dec 09 14:44:07.962263 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54714) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:07.966972 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-7c019ae0-ccab-4e6e-987c-22729e548520 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Request body: {'security_group_rule': {'security_group_id': '15ffbd79-f4ea-441f-8956-2c10355c90c0', 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:07.977297 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebcf1c19-c680-4a32-bf95-d862c9bdaf88 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Pushing event updated for resources: {'SecurityGroup': ['ID=15ffbd79-f4ea-441f-8956-2c10355c90c0,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:08.027300 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7c019ae0-ccab-4e6e-987c-22729e548520 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.057382 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Made reservation on behalf of 8d276344db394d60b4fc283713bf252e for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:44:08.062361 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.101486 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.101780 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7c019ae0-ccab-4e6e-987c-22729e548520 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.110627 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7c019ae0-ccab-4e6e-987c-22729e548520 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.141294 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'name': 'tempest-TestShelveInstance-1858903589-router', 'tenant_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.142'}], 'enable_snat': True}, 'gw_port_id': '008db50f-29f1-4f8e-adfc-3ae8286f02d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:59Z', 'updated_at': '2021-12-09T14:44:05Z', 'revision_number': 4, 'project_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'gw_port': {'id': '008db50f-29f1-4f8e-adfc-3ae8286f02d5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:73:75:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:44:00Z', 'updated_at': '2021-12-09T14:44:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '91495d3d-92f1-40a0-8137-14990e8f3b6f', 'name': '', 'network_id': 'edca1021-fd9b-45bb-ba78-6e98cb142620', 'tenant_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'mac_address': 'fa:16:3e:31:fb:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': '63f5a977-675b-413c-a956-3d5e00291d6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:44:03Z', 'updated_at': '2021-12-09T14:44:05Z', 'revision_number': 2, 'project_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'subnets': [{'id': '63f5a977-675b-413c-a956-3d5e00291d6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:44:08.161637 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c019ae0-ccab-4e6e-987c-22729e548520 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=732833b1-bee4-42d7-bc40-a08e04f53698,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:08.175137 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7c019ae0-ccab-4e6e-987c-22729e548520 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.180060 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-7c019ae0-ccab-4e6e-987c-22729e548520 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2167203 Dec 09 14:44:08.182971 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54726) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:08.186990 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b56c782b-1409-4b74-8510-1f354ab20e0f req-cea2268f-c5db-4a89-85b9-8dbd5de2cb6f tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 210 time: 0.0369263 Dec 09 14:44:08.187252 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Checking router: 7ee633f5-6fc0-47fb-b142-36d2466f7abd for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:44:08.187783 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Updating router 7ee633f5-6fc0-47fb-b142-36d2466f7abd port 91495d3d-92f1-40a0-8137-14990e8f3b6f binding host dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:44:08.191004 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-334209c9-3560-45bf-84fc-c60ed0775bb6 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Request body: {'security_group_rule': {'security_group_id': '15ffbd79-f4ea-441f-8956-2c10355c90c0', 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:08.216747 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.237538 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-334209c9-3560-45bf-84fc-c60ed0775bb6 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.249046 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.257311 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.301189 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-334209c9-3560-45bf-84fc-c60ed0775bb6 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.305504 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-334209c9-3560-45bf-84fc-c60ed0775bb6 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.325524 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-334209c9-3560-45bf-84fc-c60ed0775bb6 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c59ec0b8-64da-4936-94f0-fdc044e48897,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:08.332861 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a1327724-743a-4797-bc19-aa72c364eff4,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:08.346339 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-334209c9-3560-45bf-84fc-c60ed0775bb6 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.348339 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-334209c9-3560-45bf-84fc-c60ed0775bb6 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1636076 Dec 09 14:44:08.350692 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54730) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:08.355951 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-7208095f-25c1-4d01-a1d4-d37c62d826a5 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Request body: {'security_group_rule': {'security_group_id': '15ffbd79-f4ea-441f-8956-2c10355c90c0', 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:08.389769 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7208095f-25c1-4d01-a1d4-d37c62d826a5 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.428561 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Allocated IP 192.168.233.153 (11abbada-ef44-4275-ad88-90374a31e950/5861390c-9e39-46da-9b62-598ef23384d8/7fa5aa0e-36ee-4a3e-9313-65dc31bb2266) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:44:08.475463 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7208095f-25c1-4d01-a1d4-d37c62d826a5 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.480712 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7208095f-25c1-4d01-a1d4-d37c62d826a5 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.503451 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7208095f-25c1-4d01-a1d4-d37c62d826a5 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7353ebed-2050-42a4-be97-7f908a7ae41a,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:08.514700 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7208095f-25c1-4d01-a1d4-d37c62d826a5 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.518613 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-7208095f-25c1-4d01-a1d4-d37c62d826a5 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1642575 Dec 09 14:44:08.519034 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54732) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:08.521774 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Publish callbacks [] for port, precommit_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.524218 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-69a2a35e-fd51-414a-9961-81277a7154d2 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Request body: {'security_group_rule': {'security_group_id': '15ffbd79-f4ea-441f-8956-2c10355c90c0', 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:08.531386 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.567020 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-69a2a35e-fd51-414a-9961-81277a7154d2 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.626414 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82e8819d-547b-468c-a2f9-51497547bed3 None None] Pushing event updated for resources: {'Port': ['ID=91495d3d-92f1-40a0-8137-14990e8f3b6f,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:08.650818 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.694559 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-69a2a35e-fd51-414a-9961-81277a7154d2 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.700867 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Attempting to bind port 91495d3d-92f1-40a0-8137-14990e8f3b6f on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:44:08.701536 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Attempting to bind port 91495d3d-92f1-40a0-8137-14990e8f3b6f by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': '5ff332d6-98f0-4e32-b597-ce3b7eef375d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'edca1021-fd9b-45bb-ba78-6e98cb142620'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:44:08.702092 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Attempting to bind port 91495d3d-92f1-40a0-8137-14990e8f3b6f on network edca1021-fd9b-45bb-ba78-6e98cb142620 {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:44:08.708516 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 44, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:44:08.709201 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Checking segment: {'id': '5ff332d6-98f0-4e32-b597-ce3b7eef375d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'edca1021-fd9b-45bb-ba78-6e98cb142620'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:44:08.709905 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.710499 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Bound using segment: {'id': '5ff332d6-98f0-4e32-b597-ce3b7eef375d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'edca1021-fd9b-45bb-ba78-6e98cb142620'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:44:08.711145 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Bound port: 91495d3d-92f1-40a0-8137-14990e8f3b6f, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5ff332d6-98f0-4e32-b597-ce3b7eef375d', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 419, 'network_id': 'edca1021-fd9b-45bb-ba78-6e98cb142620'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:44:08.711775 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.724784 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-69a2a35e-fd51-414a-9961-81277a7154d2 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.728459 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.763159 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69a2a35e-fd51-414a-9961-81277a7154d2 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4bbfbefd-7d4c-47ae-b36e-8f38634e3544,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:08.779939 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-69a2a35e-fd51-414a-9961-81277a7154d2 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.784194 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-69a2a35e-fd51-414a-9961-81277a7154d2 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2640264 Dec 09 14:44:08.784794 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54746) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:08.792484 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-1470112e-d5ed-4dbe-b69b-8ffe3b82bd05 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Request body: {'security_group_rule': {'security_group_id': '15ffbd79-f4ea-441f-8956-2c10355c90c0', 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:08.800432 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] For port 91495d3d-92f1-40a0-8137-14990e8f3b6f, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:44:08.807375 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] For port 91495d3d-92f1-40a0-8137-14990e8f3b6f, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=91495d3d-92f1-40a0-8137-14990e8f3b6f,segment=NetworkSegment(5ff332d6-98f0-4e32-b597-ce3b7eef375d),segment_id=5ff332d6-98f0-4e32-b597-ce3b7eef375d)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:44:08.817228 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.832079 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.securitygroups_db [None req-1470112e-d5ed-4dbe-b69b-8ffe3b82bd05 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Project 10d73d0acf44499e88f6d53847b2094e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 14:44:08.845139 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1470112e-d5ed-4dbe-b69b-8ffe3b82bd05 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:08.857776 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Network 11abbada-ef44-4275-ad88-90374a31e950 is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:44:08.858661 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Pushing event updated for resources: {'Port': ['ID=7fa5aa0e-36ee-4a3e-9313-65dc31bb2266,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:08.864246 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:44:08.866927 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:44:08.920498 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9609d17-a438-4fa5-b544-22bcdebd853f req-c4f473ec-5e1b-4e01-a07d-bdbecbcbf3df tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:08.928391 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c9609d17-a438-4fa5-b544-22bcdebd853f req-c4f473ec-5e1b-4e01-a07d-bdbecbcbf3df tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.1794555 Dec 09 14:44:08.944382 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82e8819d-547b-468c-a2f9-51497547bed3 None None] Pushing event updated for resources: {'Port': ['ID=91495d3d-92f1-40a0-8137-14990e8f3b6f,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:08.967560 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Routers {'7ee633f5-6fc0-47fb-b142-36d2466f7abd'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:44:08.968360 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:43:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['7ee633f5-6fc0-47fb-b142-36d2466f7abd'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:44:08.968663 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:08.969931 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.027598 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-19a288cf-a9cc-4697-a688-6a6e51644d38 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.1782222 Dec 09 14:44:09.048368 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1470112e-d5ed-4dbe-b69b-8ffe3b82bd05 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.053472 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c9609d17-a438-4fa5-b544-22bcdebd853f req-f8ca01f6-b37f-485b-b976-cff41b1bc21e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1218472 Dec 09 14:44:09.063708 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1470112e-d5ed-4dbe-b69b-8ffe3b82bd05 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.073341 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Request body: {'port': {'device_id': '9c22cb81-5912-4c52-933a-aba88e03e404', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:09.123566 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1470112e-d5ed-4dbe-b69b-8ffe3b82bd05 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.128376 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-1470112e-d5ed-4dbe-b69b-8ffe3b82bd05 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3419213 Dec 09 14:44:09.130453 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54760) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:09.134364 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 008db50f-29f1-4f8e-adfc-3ae8286f02d5 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:44:09.136155 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-a1a0d96c-3d49-4be5-8152-56ffa9721b5a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Request body: {'security_group_rule': {'security_group_id': '15ffbd79-f4ea-441f-8956-2c10355c90c0', 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:09.143587 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1470112e-d5ed-4dbe-b69b-8ffe3b82bd05 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=4cf0be4c-3946-4e00-902b-a0b76d27b8f5,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:09.171863 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.securitygroups_db [None req-a1a0d96c-3d49-4be5-8152-56ffa9721b5a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Project 10d73d0acf44499e88f6d53847b2094e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 14:44:09.181074 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a1a0d96c-3d49-4be5-8152-56ffa9721b5a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.262769 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.279854 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a1a0d96c-3d49-4be5-8152-56ffa9721b5a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.288584 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a1a0d96c-3d49-4be5-8152-56ffa9721b5a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.322777 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1a0d96c-3d49-4be5-8152-56ffa9721b5a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c18c0a00-86f0-474d-aafd-606e55267326,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:09.334145 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a1a0d96c-3d49-4be5-8152-56ffa9721b5a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.335840 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-4cb8a0e7-d9d2-4779-a537-8a57e4c43bc9 None None] Provisioning complete for port 91495d3d-92f1-40a0-8137-14990e8f3b6f triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:09.336421 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4cb8a0e7-d9d2-4779-a537-8a57e4c43bc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.345183 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-a1a0d96c-3d49-4be5-8152-56ffa9721b5a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2056546 Dec 09 14:44:09.406933 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] Set router 7ee633f5-6fc0-47fb-b142-36d2466f7abd gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:44:09.456214 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 008db50f-29f1-4f8e-adfc-3ae8286f02d5 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:09.456583 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.468931 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4ec70db-bf05-41ad-9286-a552a0bc0c37 req-179fc58c-d8cc-4200-b458-5dd879f136c2 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:09.473993 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c4ec70db-bf05-41ad-9286-a552a0bc0c37 req-179fc58c-d8cc-4200-b458-5dd879f136c2 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 936 time: 0.0941131 Dec 09 14:44:09.573391 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c4ec70db-bf05-41ad-9286-a552a0bc0c37 req-34802368-a5e6-4dfc-beae-7082cfcdebe3 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/security-groups?id=a1327724-743a-4797-bc19-aa72c364eff4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0841110 Dec 09 14:44:09.578687 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4cb8a0e7-d9d2-4779-a537-8a57e4c43bc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.745319 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-4cb8a0e7-d9d2-4779-a537-8a57e4c43bc9 None None] For port 91495d3d-92f1-40a0-8137-14990e8f3b6f, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=91495d3d-92f1-40a0-8137-14990e8f3b6f,segment=NetworkSegment(5ff332d6-98f0-4e32-b597-ce3b7eef375d),segment_id=5ff332d6-98f0-4e32-b597-ce3b7eef375d)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:09.766318 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:44:09.771908 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4cb8a0e7-d9d2-4779-a537-8a57e4c43bc9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.776377 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.789231 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Transition to ACTIVE for port object 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:44:09.796839 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.845102 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Pushing event updated for resources: {'Port': ['ID=7fa5aa0e-36ee-4a3e-9313-65dc31bb2266,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:09.935911 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cb8a0e7-d9d2-4779-a537-8a57e4c43bc9 None None] Pushing event updated for resources: {'Port': ['ID=91495d3d-92f1-40a0-8137-14990e8f3b6f,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:09.948047 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Attempting to bind port 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:44:09.948685 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Attempting to bind port 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': 'f2938b2b-aa1e-4229-9424-41a0fb9d15c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': '11abbada-ef44-4275-ad88-90374a31e950'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:44:09.949365 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Attempting to bind port 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 on network 11abbada-ef44-4275-ad88-90374a31e950 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:44:09.954289 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Port 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 on network 11abbada-ef44-4275-ad88-90374a31e950 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:44:09.959782 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-2c5dbccd-38f7-410e-8fb2-adfaa801a9d0 None None] Provisioning complete for port 91495d3d-92f1-40a0-8137-14990e8f3b6f triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:09.960157 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-2c5dbccd-38f7-410e-8fb2-adfaa801a9d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:09.962903 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Attempting to bind port 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 on network 11abbada-ef44-4275-ad88-90374a31e950 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:44:09.968643 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 43, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:44:09.968980 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Checking segment: {'id': 'f2938b2b-aa1e-4229-9424-41a0fb9d15c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': '11abbada-ef44-4275-ad88-90374a31e950'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:44:09.969362 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Bound using segment: {'id': 'f2938b2b-aa1e-4229-9424-41a0fb9d15c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': '11abbada-ef44-4275-ad88-90374a31e950'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:44:09.969793 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Bound port: 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f2938b2b-aa1e-4229-9424-41a0fb9d15c1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 444, 'network_id': '11abbada-ef44-4275-ad88-90374a31e950'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:44:09.970147 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:10.000826 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'name': 'tempest-TestShelveInstance-1858903589-router', 'tenant_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.142'}], 'enable_snat': True}, 'gw_port_id': '008db50f-29f1-4f8e-adfc-3ae8286f02d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:59Z', 'updated_at': '2021-12-09T14:44:05Z', 'revision_number': 4, 'project_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'gw_port': {'id': '008db50f-29f1-4f8e-adfc-3ae8286f02d5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:73:75:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:44:00Z', 'updated_at': '2021-12-09T14:44:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '91495d3d-92f1-40a0-8137-14990e8f3b6f', 'name': '', 'network_id': 'edca1021-fd9b-45bb-ba78-6e98cb142620', 'tenant_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'mac_address': 'fa:16:3e:31:fb:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': '63f5a977-675b-413c-a956-3d5e00291d6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:44:03Z', 'updated_at': '2021-12-09T14:44:08Z', 'revision_number': 4, 'project_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'subnets': [{'id': '63f5a977-675b-413c-a956-3d5e00291d6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:44:10.035222 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a195e1c-2293-43de-96df-b273ab61a578 None None] The sync data for ids ['7ee633f5-6fc0-47fb-b142-36d2466f7abd'] in dv-cinder-819692-8-iscsi is: [{'id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'name': 'tempest-TestShelveInstance-1858903589-router', 'tenant_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.142'}], 'enable_snat': True}, 'gw_port_id': '008db50f-29f1-4f8e-adfc-3ae8286f02d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:59Z', 'updated_at': '2021-12-09T14:44:05Z', 'revision_number': 4, 'project_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'gw_port': {'id': '008db50f-29f1-4f8e-adfc-3ae8286f02d5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:73:75:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:44:00Z', 'updated_at': '2021-12-09T14:44:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '91495d3d-92f1-40a0-8137-14990e8f3b6f', 'name': '', 'network_id': 'edca1021-fd9b-45bb-ba78-6e98cb142620', 'tenant_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'mac_address': 'fa:16:3e:31:fb:ee', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'device_owner': 'network:router_interface', 'standard_attr_id': 309, 'fixed_ips': [{'subnet_id': '63f5a977-675b-413c-a956-3d5e00291d6e', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:44:03Z', 'updated_at': '2021-12-09T14:44:08Z', 'revision_number': 4, 'project_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'subnets': [{'id': '63f5a977-675b-413c-a956-3d5e00291d6e', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:44:10.048110 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] For port 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:44:10.052321 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] For port 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=7fa5aa0e-36ee-4a3e-9313-65dc31bb2266,segment=NetworkSegment(f2938b2b-aa1e-4229-9424-41a0fb9d15c1),segment_id=f2938b2b-aa1e-4229-9424-41a0fb9d15c1)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:44:10.058132 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:10.170725 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:10.171362 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:10.174167 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] 10.222.0.44 "PUT /v2.0/ports/7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 HTTP/1.1" status: 200 len: 1098 time: 1.1196442 Dec 09 14:44:10.174623 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '9c22cb81-5912-4c52-933a-aba88e03e404', 'tag': '7fa5aa0e-36ee-4a3e-9313-65dc31bb2266'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:44:10.192468 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-734c2368-df06-4858-8a5c-2b2154c493d7" -d '{"events": [{"name": "network-changed", "server_uuid": "9c22cb81-5912-4c52-933a-aba88e03e404", "tag": "7fa5aa0e-36ee-4a3e-9313-65dc31bb2266"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:44:10.316589 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:44:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e6ca491a-2d48-4743-a988-ae101d5b8afc x-openstack-request-id: req-e6ca491a-2d48-4743-a988-ae101d5b8afc {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:44:10.318135 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "9c22cb81-5912-4c52-933a-aba88e03e404", "tag": "7fa5aa0e-36ee-4a3e-9313-65dc31bb2266", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:44:10.318135 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-e6ca491a-2d48-4743-a988-ae101d5b8afc {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:44:10.318135 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '9c22cb81-5912-4c52-933a-aba88e03e404', 'tag': '7fa5aa0e-36ee-4a3e-9313-65dc31bb2266', 'status': 'completed', 'code': 200} Dec 09 14:44:10.331375 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95064817-ae12-4e45-8bd9-376cf649ef59 service neutron] Pushing event updated for resources: {'Port': ['ID=7fa5aa0e-36ee-4a3e-9313-65dc31bb2266,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:10.371992 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-79b5e038-aa53-46a6-a3e0-8fc0e23f3754 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:10.374269 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-79b5e038-aa53-46a6-a3e0-8fc0e23f3754 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=8d276344db394d60b4fc283713bf252e&device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 1101 time: 0.1303823 Dec 09 14:44:10.384551 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb36acdc-e6ae-4bbc-9ade-fabf7ee9b6d7 req-74e381e1-7e70-4059-84b5-640402b50d05 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:10.397104 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-eb36acdc-e6ae-4bbc-9ade-fabf7ee9b6d7 req-74e381e1-7e70-4059-84b5-640402b50d05 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.1354849 Dec 09 14:44:10.460181 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-cc0c199b-7e61-4606-a0bc-cc0b676bc43f service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.153&port_id=7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 HTTP/1.1" status: 200 len: 217 time: 0.0605755 Dec 09 14:44:10.552403 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-eb36acdc-e6ae-4bbc-9ade-fabf7ee9b6d7 req-b8d4c623-af30-4d88-ac56-d3dd9cdf545c tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1544068 Dec 09 14:44:10.572486 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-ae4f9d30-a0f8-43f4-845c-2abd8e377a83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:10.574440 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-ae4f9d30-a0f8-43f4-845c-2abd8e377a83 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=5861390c-9e39-46da-9b62-598ef23384d8 HTTP/1.1" status: 200 len: 843 time: 0.0905719 Dec 09 14:44:10.632201 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-04d87c28-6407-4722-aebf-758b3eb85b92 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:10.634128 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-04d87c28-6407-4722-aebf-758b3eb85b92 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=11abbada-ef44-4275-ad88-90374a31e950&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0506232 Dec 09 14:44:10.784095 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-2de7e8dc-122e-4e94-b7e4-f9923993064c service neutron] 10.222.0.44 "GET /v2.0/networks/11abbada-ef44-4275-ad88-90374a31e950?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1353881 Dec 09 14:44:10.786743 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-408d0752-2100-46e4-98d9-b10cf17f13b7 req-939d7385-14e6-4cc7-9996-cdf670fa548c tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:10.792119 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-408d0752-2100-46e4-98d9-b10cf17f13b7 req-939d7385-14e6-4cc7-9996-cdf670fa548c tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 948 time: 0.1034570 Dec 09 14:44:10.896288 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-408d0752-2100-46e4-98d9-b10cf17f13b7 req-cd531f81-cbbe-4187-87d8-07b0edc81872 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/security-groups?id=a1327724-743a-4797-bc19-aa72c364eff4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0959623 Dec 09 14:44:10.933510 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54876) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:10.941668 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4b3c2eff-768c-442f-9342-c186ca45b772 req-3e2442f2-2138-45bc-8538-e4b21e84ff13 service neutron] 10.222.0.44 "GET /v2.0/networks/11abbada-ef44-4275-ad88-90374a31e950?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1398752 Dec 09 14:44:11.069559 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-734c2368-df06-4858-8a5c-2b2154c493d7 req-49f81a51-9ac5-46c6-a021-fe360b789f3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:11.071109 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-734c2368-df06-4858-8a5c-2b2154c493d7 req-49f81a51-9ac5-46c6-a021-fe360b789f3f service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=8d276344db394d60b4fc283713bf252e&device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 1101 time: 0.0492160 Dec 09 14:44:11.100580 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 91495d3d-92f1-40a0-8137-14990e8f3b6f up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:44:11.160889 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5f657714-da40-40d5-b51e-5717c65fd90f admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:11.179009 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 91495d3d-92f1-40a0-8137-14990e8f3b6f triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:11.179380 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:11.229642 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-734c2368-df06-4858-8a5c-2b2154c493d7 req-4d3d0651-a005-45a3-a846-c19863e806c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:11.231244 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-734c2368-df06-4858-8a5c-2b2154c493d7 req-4d3d0651-a005-45a3-a846-c19863e806c4 service neutron] 10.222.0.44 "GET /v2.0/networks?id=11abbada-ef44-4275-ad88-90374a31e950 HTTP/1.1" status: 200 len: 870 time: 0.1423306 Dec 09 14:44:11.324673 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-734c2368-df06-4858-8a5c-2b2154c493d7 req-e1e67e94-8874-4265-9d6d-ad99539a291c service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.153&port_id=7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 HTTP/1.1" status: 200 len: 217 time: 0.0839694 Dec 09 14:44:11.338357 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5f657714-da40-40d5-b51e-5717c65fd90f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:11.347321 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5f657714-da40-40d5-b51e-5717c65fd90f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:11.388888 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-5f657714-da40-40d5-b51e-5717c65fd90f admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=9d5d4a2853ca4ff785a22a475d1d4ab4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4542730 Dec 09 14:44:11.390382 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f657714-da40-40d5-b51e-5717c65fd90f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f26a48e0-812e-49bb-9b0e-cb6027538e67,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:11.391966 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 54896) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:11.417565 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-734c2368-df06-4858-8a5c-2b2154c493d7 req-a17f356a-074f-4cda-b205-528b9f3e4c24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:11.419043 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-734c2368-df06-4858-8a5c-2b2154c493d7 req-a17f356a-074f-4cda-b205-528b9f3e4c24 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=5861390c-9e39-46da-9b62-598ef23384d8 HTTP/1.1" status: 200 len: 843 time: 0.0847368 Dec 09 14:44:11.481494 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-9cdfae6d-b2e3-4578-b56a-d6f6e10577d5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:11.496547 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-734c2368-df06-4858-8a5c-2b2154c493d7 req-e1f4f9cd-0ef8-46f7-bff2-77dade38298f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:11.498076 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-734c2368-df06-4858-8a5c-2b2154c493d7 req-e1f4f9cd-0ef8-46f7-bff2-77dade38298f service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=11abbada-ef44-4275-ad88-90374a31e950&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.0665445 Dec 09 14:44:11.510562 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-9cdfae6d-b2e3-4578-b56a-d6f6e10577d5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:11.617026 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-734c2368-df06-4858-8a5c-2b2154c493d7 req-aef6a945-cea2-417a-a759-7938e0078033 service neutron] 10.222.0.44 "GET /v2.0/networks/11abbada-ef44-4275-ad88-90374a31e950?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1085663 Dec 09 14:44:11.623375 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-9cdfae6d-b2e3-4578-b56a-d6f6e10577d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:11.626042 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-9cdfae6d-b2e3-4578-b56a-d6f6e10577d5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:11.629582 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-9cdfae6d-b2e3-4578-b56a-d6f6e10577d5 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/f26a48e0-812e-49bb-9b0e-cb6027538e67 HTTP/1.1" status: 204 len: 168 time: 0.2340882 Dec 09 14:44:11.653419 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cdfae6d-b2e3-4578-b56a-d6f6e10577d5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f26a48e0-812e-49bb-9b0e-cb6027538e67,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:11.683882 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e80a5d2-c697-45f7-951a-dadf9424391d req-51d5b4aa-891f-497c-a5b8-3917e36bd316 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:11.685951 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-9e80a5d2-c697-45f7-951a-dadf9424391d req-51d5b4aa-891f-497c-a5b8-3917e36bd316 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0533104 Dec 09 14:44:11.750041 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-734c2368-df06-4858-8a5c-2b2154c493d7 req-2617bef6-98a8-468f-8cf7-2642f845077a service neutron] 10.222.0.44 "GET /v2.0/networks/11abbada-ef44-4275-ad88-90374a31e950?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1217599 Dec 09 14:44:11.757705 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-9e80a5d2-c697-45f7-951a-dadf9424391d req-d69b3f4d-3f51-4123-997f-bf441eb79e05 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0587733 Dec 09 14:44:11.966371 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 54910) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:11.980548 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5ffd2018-63ec-4160-8acc-5d2d9b353f64 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:12.021803 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7ca9860-3218-4074-9382-851bb9f14a94 req-91a8a9ec-bf2b-4366-a13a-f8677ef2e65f tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:12.023484 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a7ca9860-3218-4074-9382-851bb9f14a94 req-91a8a9ec-bf2b-4366-a13a-f8677ef2e65f tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 948 time: 0.0549204 Dec 09 14:44:12.065967 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5ffd2018-63ec-4160-8acc-5d2d9b353f64 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:12.071694 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5ffd2018-63ec-4160-8acc-5d2d9b353f64 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:12.081075 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a7ca9860-3218-4074-9382-851bb9f14a94 req-a0dd6a15-1f17-40a2-966a-3a4dbf8377d1 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/security-groups?id=a1327724-743a-4797-bc19-aa72c364eff4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493135 Dec 09 14:44:12.109596 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-5ffd2018-63ec-4160-8acc-5d2d9b353f64 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=7ac11fa4bef24314ab4aaec07a04a1f5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1419976 Dec 09 14:44:12.112265 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54914) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:12.121255 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ffd2018-63ec-4160-8acc-5d2d9b353f64 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d5aeb656-34bd-4c9d-a708-0099abaf849a,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:12.166891 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f1dc0e4e-10b7-4239-9367-d16e2bc3b301 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:12.190183 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f1dc0e4e-10b7-4239-9367-d16e2bc3b301 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:12.219272 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf854392-ef3b-4710-809b-e7f80c70bace req-7a234256-e3de-45ab-8085-814c3fcbc1d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:12.220936 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cf854392-ef3b-4710-809b-e7f80c70bace req-7a234256-e3de-45ab-8085-814c3fcbc1d6 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 1098 time: 0.0398505 Dec 09 14:44:12.236635 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f1dc0e4e-10b7-4239-9367-d16e2bc3b301 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:12.239883 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f1dc0e4e-10b7-4239-9367-d16e2bc3b301 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:12.241149 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-f1dc0e4e-10b7-4239-9367-d16e2bc3b301 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/d5aeb656-34bd-4c9d-a708-0099abaf849a HTTP/1.1" status: 204 len: 168 time: 0.1277471 Dec 09 14:44:12.249574 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1dc0e4e-10b7-4239-9367-d16e2bc3b301 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5aeb656-34bd-4c9d-a708-0099abaf849a,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:12.289484 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cf854392-ef3b-4710-809b-e7f80c70bace req-4cfbe297-721d-4256-91f8-e3ab40dd2465 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469747 Dec 09 14:44:12.588030 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 54938) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:12.601905 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a1a069eb-f68c-4155-9e70-96cd98f86a8b admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:12.680024 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a1a069eb-f68c-4155-9e70-96cd98f86a8b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:12.685603 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a1a069eb-f68c-4155-9e70-96cd98f86a8b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:12.724095 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-a1a069eb-f68c-4155-9e70-96cd98f86a8b admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=a5e9fb3edeb24cccb30ca9885d77548b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1349192 Dec 09 14:44:12.725002 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1a069eb-f68c-4155-9e70-96cd98f86a8b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14d9b7a9-861d-4396-86d9-c7f93ae98bd5,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:12.727368 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 54944) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:12.780169 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e48cd1d7-767b-4b4e-97d0-21a5729730f2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:12.802519 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e48cd1d7-767b-4b4e-97d0-21a5729730f2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:12.862308 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e48cd1d7-767b-4b4e-97d0-21a5729730f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:12.865274 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e48cd1d7-767b-4b4e-97d0-21a5729730f2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:12.866742 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-e48cd1d7-767b-4b4e-97d0-21a5729730f2 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/14d9b7a9-861d-4396-86d9-c7f93ae98bd5 HTTP/1.1" status: 204 len: 168 time: 0.1382961 Dec 09 14:44:12.876906 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e48cd1d7-767b-4b4e-97d0-21a5729730f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14d9b7a9-861d-4396-86d9-c7f93ae98bd5,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:12.917237 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28919ab7-218f-4bfb-a908-600a736b9432 req-2c005106-7a31-4efc-b6c9-b682db94241d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:12.918999 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-28919ab7-218f-4bfb-a908-600a736b9432 req-2c005106-7a31-4efc-b6c9-b682db94241d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0796499 Dec 09 14:44:12.989269 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-28919ab7-218f-4bfb-a908-600a736b9432 req-972ab68c-0c55-433b-a733-f2852bb4ab2f tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0606854 Dec 09 14:44:13.035529 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 54960) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:13.154089 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-91e68860-f402-4c8c-82c7-64b7b620ad47 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:13.204344 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b88ea0-9e47-4061-9d27-86e98bd6d549 req-1e8affa1-f6ec-46d8-802b-d6529cd8b0da tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:13.206728 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d4b88ea0-9e47-4061-9d27-86e98bd6d549 req-1e8affa1-f6ec-46d8-802b-d6529cd8b0da tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 948 time: 0.0501151 Dec 09 14:44:13.244951 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-91e68860-f402-4c8c-82c7-64b7b620ad47 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:13.251486 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-91e68860-f402-4c8c-82c7-64b7b620ad47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:13.269147 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d4b88ea0-9e47-4061-9d27-86e98bd6d549 req-d65fa1c7-b1d8-40cf-997b-94e861bfe991 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/security-groups?id=a1327724-743a-4797-bc19-aa72c364eff4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552464 Dec 09 14:44:13.301901 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-91e68860-f402-4c8c-82c7-64b7b620ad47 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=0964aca93102428a975d28c7b0761aa2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2654126 Dec 09 14:44:13.303143 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91e68860-f402-4c8c-82c7-64b7b620ad47 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=75af7233-0dde-4681-83a1-33158d63306f,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:13.304838 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 54978) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:13.360629 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-fe868e6b-6f26-40b2-8347-15ace17a87f2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:13.382562 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-fe868e6b-6f26-40b2-8347-15ace17a87f2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:13.434570 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-fe868e6b-6f26-40b2-8347-15ace17a87f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:13.438085 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-fe868e6b-6f26-40b2-8347-15ace17a87f2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:13.439463 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-fe868e6b-6f26-40b2-8347-15ace17a87f2 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/75af7233-0dde-4681-83a1-33158d63306f HTTP/1.1" status: 204 len: 168 time: 0.1335819 Dec 09 14:44:13.453819 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe868e6b-6f26-40b2-8347-15ace17a87f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=75af7233-0dde-4681-83a1-33158d63306f,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:13.782116 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 55000) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:13.798188 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-16be09ab-19a9-46d6-b58f-2478f236abac admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:13.876707 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-16be09ab-19a9-46d6-b58f-2478f236abac admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:13.884895 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-16be09ab-19a9-46d6-b58f-2478f236abac admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:13.925728 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-16be09ab-19a9-46d6-b58f-2478f236abac admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=0e6bf8a7f7514bd29d016abcc3866ff3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1400409 Dec 09 14:44:13.925961 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 55002) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:13.932097 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16be09ab-19a9-46d6-b58f-2478f236abac admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=540da162-ced4-4019-95e1-a8b77957a5c5,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:13.980802 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f01221a0-5537-42a7-b294-445c1ecaf1b9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:14.010122 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f01221a0-5537-42a7-b294-445c1ecaf1b9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:14.067089 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f01221a0-5537-42a7-b294-445c1ecaf1b9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:14.069655 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f01221a0-5537-42a7-b294-445c1ecaf1b9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:14.070754 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-f01221a0-5537-42a7-b294-445c1ecaf1b9 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/540da162-ced4-4019-95e1-a8b77957a5c5 HTTP/1.1" status: 204 len: 168 time: 0.1438932 Dec 09 14:44:14.080222 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 55012) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:14.116944 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f01221a0-5537-42a7-b294-445c1ecaf1b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=540da162-ced4-4019-95e1-a8b77957a5c5,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:14.157284 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab488d27-5b48-4ee8-8295-8b2ca836dfc9 req-b5b92393-eb66-4997-ae82-a621d2b3dad5 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:14.158993 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ab488d27-5b48-4ee8-8295-8b2ca836dfc9 req-b5b92393-eb66-4997-ae82-a621d2b3dad5 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.1009555 Dec 09 14:44:14.220011 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ab488d27-5b48-4ee8-8295-8b2ca836dfc9 req-7bff500a-49c4-4d94-93f9-3bcaf02e64cc tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502515 Dec 09 14:44:14.343867 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea05e722-0fb6-4870-9e40-df712d51949e req-d5ce29ef-d881-4ad9-b8a3-35c547cbd23b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:14.345523 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ea05e722-0fb6-4870-9e40-df712d51949e req-d5ce29ef-d881-4ad9-b8a3-35c547cbd23b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0597060 Dec 09 14:44:14.374559 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5dfb905f-c1ca-4fe0-901b-db93d6592799 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:14.418060 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-454c27da-fe30-4c9b-8d4d-c8eb91765f43 req-5626507b-3d57-47be-b6c2-eaefb1c923b9 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:14.429109 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-454c27da-fe30-4c9b-8d4d-c8eb91765f43 req-5626507b-3d57-47be-b6c2-eaefb1c923b9 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 948 time: 0.0773318 Dec 09 14:44:14.449737 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ea05e722-0fb6-4870-9e40-df712d51949e req-b974e4a5-5c27-42ad-aed4-ade1b2de90d3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0903840 Dec 09 14:44:14.517703 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-454c27da-fe30-4c9b-8d4d-c8eb91765f43 req-9b6014e0-17a7-4256-828f-2fc3b3218eb6 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/security-groups?id=a1327724-743a-4797-bc19-aa72c364eff4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0875330 Dec 09 14:44:14.545104 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5dfb905f-c1ca-4fe0-901b-db93d6592799 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:14.551077 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5dfb905f-c1ca-4fe0-901b-db93d6592799 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:14.593915 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-5dfb905f-c1ca-4fe0-901b-db93d6592799 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=c90fd07df47b491a990db0288f0fa9b2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5101531 Dec 09 14:44:14.593915 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5dfb905f-c1ca-4fe0-901b-db93d6592799 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b649ce0-ae6f-411e-9694-42f3140fce91,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:14.594280 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 55038) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:14.683274 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-abe399a7-1e14-40ab-bf9f-6a7badfc9740 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:14.713383 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-abe399a7-1e14-40ab-bf9f-6a7badfc9740 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:14.755689 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:14.790718 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-abe399a7-1e14-40ab-bf9f-6a7badfc9740 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:14.793480 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-abe399a7-1e14-40ab-bf9f-6a7badfc9740 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:14.804432 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-abe399a7-1e14-40ab-bf9f-6a7badfc9740 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/8b649ce0-ae6f-411e-9694-42f3140fce91 HTTP/1.1" status: 204 len: 168 time: 0.2090487 Dec 09 14:44:14.810989 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:44:14.813128 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abe399a7-1e14-40ab-bf9f-6a7badfc9740 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b649ce0-ae6f-411e-9694-42f3140fce91,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:14.919774 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=7fa5aa0e-36ee-4a3e-9313-65dc31bb2266,segment=NetworkSegment(f2938b2b-aa1e-4229-9424-41a0fb9d15c1),segment_id=f2938b2b-aa1e-4229-9424-41a0fb9d15c1)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:14.933959 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': '7fa5aa0e-36ee-4a3e-9313-65dc31bb2266', 'network_id': '11abbada-ef44-4275-ad88-90374a31e950', 'port_id': '7fa5aa0e-36ee-4a3e-9313-65dc31bb2266', 'mac_address': 'fa:16:3e:20:90:03', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 444, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '5861390c-9e39-46da-9b62-598ef23384d8', 'ip_address': '192.168.233.153'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:44:14.974834 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:14.994854 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:44:15.025847 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=7fa5aa0e-36ee-4a3e-9313-65dc31bb2266,segment=NetworkSegment(f2938b2b-aa1e-4229-9424-41a0fb9d15c1),segment_id=f2938b2b-aa1e-4229-9424-41a0fb9d15c1)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:15.032983 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:15.094650 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=7fa5aa0e-36ee-4a3e-9313-65dc31bb2266,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:15.495298 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['7fa5aa0e-36ee-4a3e-9313-65dc31bb2266'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:44:15.722266 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9caca577-1b3d-44f8-b894-dd49df51c4be req-409a3ae7-b16e-4a97-ad32-52ec08680c80 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:15.723952 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9caca577-1b3d-44f8-b894-dd49df51c4be req-409a3ae7-b16e-4a97-ad32-52ec08680c80 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 949 time: 0.1099737 Dec 09 14:44:15.800696 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9caca577-1b3d-44f8-b894-dd49df51c4be req-306d9bf9-e346-4d5a-8553-07c5f21a2496 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/security-groups?id=a1327724-743a-4797-bc19-aa72c364eff4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0618095 Dec 09 14:44:16.079632 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29015e10-752b-4571-b5ae-e438afaa3b28 req-702d03c2-4ff1-485f-a356-6325929f4dac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:16.081713 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-29015e10-752b-4571-b5ae-e438afaa3b28 req-702d03c2-4ff1-485f-a356-6325929f4dac service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=3d298e3ebec54c2281ddf8bbb50b7cea&device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 1098 time: 0.0545311 Dec 09 14:44:16.084441 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ee69396-9e12-493b-930b-6b1defb54c39 req-9b21c4c6-29f5-459e-b4fb-b4b084d7fbfe tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:16.092369 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-9ee69396-9e12-493b-930b-6b1defb54c39 req-9b21c4c6-29f5-459e-b4fb-b4b084d7fbfe tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0633037 Dec 09 14:44:16.149683 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-9ee69396-9e12-493b-930b-6b1defb54c39 req-b5399334-e80c-4a76-9ab0-a473bf1b1b9a tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0562341 Dec 09 14:44:16.203417 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29015e10-752b-4571-b5ae-e438afaa3b28 req-dd0ea98d-fa61-407f-872e-a442b9ed7b12 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:16.205296 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-29015e10-752b-4571-b5ae-e438afaa3b28 req-dd0ea98d-fa61-407f-872e-a442b9ed7b12 service neutron] 10.222.0.44 "GET /v2.0/networks?id=8ff38a1e-5122-4806-8b7d-d4c281cbe550 HTTP/1.1" status: 200 len: 919 time: 0.1086276 Dec 09 14:44:16.268603 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-29015e10-752b-4571-b5ae-e438afaa3b28 req-b42c9cb5-8e95-44c5-b274-200a88a61578 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=bb290a6d-709a-49d1-bd2e-10c0fe664657 HTTP/1.1" status: 200 len: 217 time: 0.0508068 Dec 09 14:44:16.337724 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29015e10-752b-4571-b5ae-e438afaa3b28 req-eaed4437-077b-410c-b8f0-f0f0b890eeba service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:16.340597 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-29015e10-752b-4571-b5ae-e438afaa3b28 req-eaed4437-077b-410c-b8f0-f0f0b890eeba service neutron] 10.222.0.44 "GET /v2.0/subnets?id=90388423-2d07-4cbe-80d8-fa2f6a3c14f7 HTTP/1.1" status: 200 len: 858 time: 0.0635045 Dec 09 14:44:16.625575 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-29015e10-752b-4571-b5ae-e438afaa3b28 req-8cb7e683-60f9-4dfa-817a-1693b50bd2c1 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=8ff38a1e-5122-4806-8b7d-d4c281cbe550&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.2600784 Dec 09 14:44:16.720339 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-29015e10-752b-4571-b5ae-e438afaa3b28 req-bf62bc78-a2fa-454a-80f4-62b9f001d2d5 service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0807815 Dec 09 14:44:16.827710 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-29015e10-752b-4571-b5ae-e438afaa3b28 req-e8aef4d2-84a2-4c70-98a4-2aad44daa3e6 service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877206 Dec 09 14:44:16.920903 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09712b2a-10e5-428d-bb2b-4f371f06d684 req-e1a51a0d-2526-4bf1-b7b4-67e8a3c298c4 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:16.922479 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-09712b2a-10e5-428d-bb2b-4f371f06d684 req-e1a51a0d-2526-4bf1-b7b4-67e8a3c298c4 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 949 time: 0.0493236 Dec 09 14:44:16.970474 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-09712b2a-10e5-428d-bb2b-4f371f06d684 req-8382c81e-9fb2-44f6-b148-3ccdc77484ff tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/security-groups?id=a1327724-743a-4797-bc19-aa72c364eff4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417128 Dec 09 14:44:17.275080 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24cb6f59-1b7e-4e09-af61-eb8e088fc2c0 req-4b20a356-908c-412d-8919-f19656af060f tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:17.276724 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-24cb6f59-1b7e-4e09-af61-eb8e088fc2c0 req-4b20a356-908c-412d-8919-f19656af060f tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0526989 Dec 09 14:44:17.330497 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-24cb6f59-1b7e-4e09-af61-eb8e088fc2c0 req-fb7352b9-7f7f-49cb-b96a-fa4ba29702f6 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0471120 Dec 09 14:44:18.098557 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14e784a9-2d6a-484f-bab5-d6120347e50b req-d8ce7640-3bc2-4da2-946e-4e0261c0be50 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:18.100192 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-14e784a9-2d6a-484f-bab5-d6120347e50b req-d8ce7640-3bc2-4da2-946e-4e0261c0be50 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 949 time: 0.0584409 Dec 09 14:44:18.149938 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-14e784a9-2d6a-484f-bab5-d6120347e50b req-1358015c-8b00-4a2d-bd51-8ff25fa630c5 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/security-groups?id=a1327724-743a-4797-bc19-aa72c364eff4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434535 Dec 09 14:44:18.460701 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beac87ea-065b-4f07-aca9-0f4d195c9853 req-8793a365-8fec-4ef9-b86c-6710b3b6c74b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:18.462808 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-beac87ea-065b-4f07-aca9-0f4d195c9853 req-8793a365-8fec-4ef9-b86c-6710b3b6c74b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0532551 Dec 09 14:44:18.512135 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-beac87ea-065b-4f07-aca9-0f4d195c9853 req-b40b967b-bbcf-4bb8-b4b4-9a460daefa76 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428479 Dec 09 14:44:18.808332 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-a6e65681-39f3-4a13-9679-154ac8595be7 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:18.809945 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-a6e65681-39f3-4a13-9679-154ac8595be7 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/networks?id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d HTTP/1.1" status: 200 len: 815 time: 0.1101708 Dec 09 14:44:18.833794 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-8a87a72c-27b4-48f5-9f80-9a7df67767f3 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/quotas/5ec989b7fd3e45f2b8962e012b0797ac HTTP/1.1" status: 200 len: 375 time: 0.0169184 Dec 09 14:44:18.842735 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:44:18.907277 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-6ab1d3c6-d1fd-4f7e-b80c-94a9b3bc67a6 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=5ec989b7fd3e45f2b8962e012b0797ac&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0725417 Dec 09 14:44:18.945760 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:44:18.953724 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:18.954335 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:19.033511 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-ab76f56e-786f-4201-a208-fc952057f279 service neutron] 10.222.0.39 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1181211 Dec 09 14:44:19.057470 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:19.091139 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c22cb81-5912-4c52-933a-aba88e03e404', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7fa5aa0e-36ee-4a3e-9313-65dc31bb2266'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:44:19.093702 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7410fa99-c94d-4e0a-aedf-580f4f606f04" -d '{"events": [{"server_uuid": "9c22cb81-5912-4c52-933a-aba88e03e404", "name": "network-vif-plugged", "status": "completed", "tag": "7fa5aa0e-36ee-4a3e-9313-65dc31bb2266"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:44:19.107258 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=7fa5aa0e-36ee-4a3e-9313-65dc31bb2266,segment=NetworkSegment(f2938b2b-aa1e-4229-9424-41a0fb9d15c1),segment_id=f2938b2b-aa1e-4229-9424-41a0fb9d15c1)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:19.113060 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:19.133441 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-58240476-4f47-4bd0-abf7-27bf201affb9 service neutron] 10.222.0.39 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0990455 Dec 09 14:44:19.168327 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:44:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4bb5bf9b-59e0-40bb-b907-38c7881a4012 x-openstack-request-id: req-4bb5bf9b-59e0-40bb-b907-38c7881a4012 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:44:19.168616 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9c22cb81-5912-4c52-933a-aba88e03e404", "name": "network-vif-plugged", "status": "completed", "tag": "7fa5aa0e-36ee-4a3e-9313-65dc31bb2266", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:44:19.168866 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-4bb5bf9b-59e0-40bb-b907-38c7881a4012 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:44:19.169257 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c22cb81-5912-4c52-933a-aba88e03e404', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7fa5aa0e-36ee-4a3e-9313-65dc31bb2266', 'code': 200} Dec 09 14:44:19.175911 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=7fa5aa0e-36ee-4a3e-9313-65dc31bb2266,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:19.318217 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73579445-2c98-4455-a4dc-87508e53a2a4 req-82b69999-510a-4e4f-bf18-7015f7baee1f tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:19.319984 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-73579445-2c98-4455-a4dc-87508e53a2a4 req-82b69999-510a-4e4f-bf18-7015f7baee1f tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 950 time: 0.0850918 Dec 09 14:44:19.328494 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 55252) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:19.374411 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c81d725f-0224-40bf-bef0-79322a0ddfa0 req-c4206f22-adb2-44a5-9852-2bf80732823f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 210 time: 0.0389986 Dec 09 14:44:19.406140 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-73579445-2c98-4455-a4dc-87508e53a2a4 req-61266454-7522-4c43-8661-bdf5716968ac tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/security-groups?id=a1327724-743a-4797-bc19-aa72c364eff4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0795598 Dec 09 14:44:19.424056 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ab348cf-405c-4e8a-b239-f209b938f0b8 req-b7570114-be66-4555-bd3c-6fa09ddc809e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:19.426041 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0ab348cf-405c-4e8a-b239-f209b938f0b8 req-b7570114-be66-4555-bd3c-6fa09ddc809e service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 1103 time: 0.0811329 Dec 09 14:44:19.485008 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0ab348cf-405c-4e8a-b239-f209b938f0b8 req-0ba0eb6d-1cde-4b14-acda-e6198a8a72a3 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=a1327724-743a-4797-bc19-aa72c364eff4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480447 Dec 09 14:44:19.504365 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-024dcb54-3f8d-405e-8349-40628acd0a7e admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:19.599953 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-024dcb54-3f8d-405e-8349-40628acd0a7e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:19.624546 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-024dcb54-3f8d-405e-8349-40628acd0a7e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:19.673470 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-024dcb54-3f8d-405e-8349-40628acd0a7e admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=21d980cfea4541109a649df789a79a1d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3436906 Dec 09 14:44:19.675182 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-024dcb54-3f8d-405e-8349-40628acd0a7e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ac9edeb7-379d-4e56-8d7d-0a9b58fae51f,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:19.676720 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 55266) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:19.684895 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd12cc6b-d180-4a4d-910f-f88c5ba71fd7 req-16c5d5b9-ea16-4f82-bcf0-8b5682c2177b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:19.686412 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-cd12cc6b-d180-4a4d-910f-f88c5ba71fd7 req-16c5d5b9-ea16-4f82-bcf0-8b5682c2177b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.1032069 Dec 09 14:44:19.739846 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e435a8e3-310a-463c-b8ca-15a66b6754fb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:19.740492 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-cd12cc6b-d180-4a4d-910f-f88c5ba71fd7 req-85d49429-8b55-46ee-ad77-fc7f114f2de6 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469058 Dec 09 14:44:19.763420 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e435a8e3-310a-463c-b8ca-15a66b6754fb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:19.816694 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e435a8e3-310a-463c-b8ca-15a66b6754fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:19.819562 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e435a8e3-310a-463c-b8ca-15a66b6754fb admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:19.823067 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-e435a8e3-310a-463c-b8ca-15a66b6754fb admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/ac9edeb7-379d-4e56-8d7d-0a9b58fae51f HTTP/1.1" status: 204 len: 168 time: 0.1419859 Dec 09 14:44:19.830887 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e435a8e3-310a-463c-b8ca-15a66b6754fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ac9edeb7-379d-4e56-8d7d-0a9b58fae51f,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:20.112155 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 55280) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:20.126384 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3f83573f-fa4d-4af4-ad02-1d623aac084e admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:20.210587 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3f83573f-fa4d-4af4-ad02-1d623aac084e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:20.215395 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3f83573f-fa4d-4af4-ad02-1d623aac084e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:20.256295 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-3f83573f-fa4d-4af4-ad02-1d623aac084e admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=3681ad7a8de14c93b5f6e68d08a31ecb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1428397 Dec 09 14:44:20.258341 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 55288) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:20.259164 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f83573f-fa4d-4af4-ad02-1d623aac084e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a151a760-057e-419e-887c-d8b33051cddd,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:20.317562 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3e0b5367-c0ad-4cb7-8d73-0de0eeb030c1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:20.339522 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3e0b5367-c0ad-4cb7-8d73-0de0eeb030c1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:20.387502 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3e0b5367-c0ad-4cb7-8d73-0de0eeb030c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:20.390176 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3e0b5367-c0ad-4cb7-8d73-0de0eeb030c1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:20.391310 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-3e0b5367-c0ad-4cb7-8d73-0de0eeb030c1 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/a151a760-057e-419e-887c-d8b33051cddd HTTP/1.1" status: 204 len: 168 time: 0.1317883 Dec 09 14:44:20.399493 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e0b5367-c0ad-4cb7-8d73-0de0eeb030c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a151a760-057e-419e-887c-d8b33051cddd,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:20.564432 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-91382afa-fc47-437c-b20a-e9279a5e59ac req-9e6eb3c9-2f0a-44b0-bba1-d20f2c473eb6 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 210 time: 0.0578437 Dec 09 14:44:20.580269 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64233757-1ce7-4595-b5e1-f3082c584249 req-4504ad09-99b5-4cdd-a620-fb737bb073c3 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:20.589322 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-64233757-1ce7-4595-b5e1-f3082c584249 req-4504ad09-99b5-4cdd-a620-fb737bb073c3 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 950 time: 0.0800018 Dec 09 14:44:20.669144 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-64233757-1ce7-4595-b5e1-f3082c584249 req-e7f83336-7b58-4347-ac03-3c21b87d1f9a tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/security-groups?id=a1327724-743a-4797-bc19-aa72c364eff4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0787606 Dec 09 14:44:20.746347 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-a9134710-1158-49ba-bbc1-197ec67c8b86 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:20.748195 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-a9134710-1158-49ba-bbc1-197ec67c8b86 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "GET /v2.0/networks?id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d HTTP/1.1" status: 200 len: 815 time: 0.1653719 Dec 09 14:44:20.768024 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-0d9279ef-86d8-42a6-b6a3-de9f5e099905 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Request body: {'port': {'device_id': 'ec116497-9e3b-4fda-8c28-119755d4df1c', 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d', 'admin_state_up': True, 'tenant_id': '5ec989b7fd3e45f2b8962e012b0797ac'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:20.936680 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a51dc860-b033-47c6-b2e0-6b9e7cadb5b5 req-47d448e6-c66e-4e64-afcd-f94e183e4e4f tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:20.945097 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a51dc860-b033-47c6-b2e0-6b9e7cadb5b5 req-47d448e6-c66e-4e64-afcd-f94e183e4e4f tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0920863 Dec 09 14:44:20.977237 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-0d9279ef-86d8-42a6-b6a3-de9f5e099905 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Made reservation on behalf of 5ec989b7fd3e45f2b8962e012b0797ac for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:44:20.980802 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-0d9279ef-86d8-42a6-b6a3-de9f5e099905 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:21.031729 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a51dc860-b033-47c6-b2e0-6b9e7cadb5b5 req-6634f27b-d1b4-435c-a326-f2e649fc3f69 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0809782 Dec 09 14:44:21.155006 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-0d9279ef-86d8-42a6-b6a3-de9f5e099905 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Allocated IP 172.20.0.6 (99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d/7c6b4bb0-bfec-44d0-8503-70917540b3c5/49a81388-ba4e-42e6-b643-dff0fadec9c5) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:44:21.360841 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-0d9279ef-86d8-42a6-b6a3-de9f5e099905 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:21.404673 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-0d9279ef-86d8-42a6-b6a3-de9f5e099905 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:21.421732 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['746ea6aa-be43-4fbf-9463-02d741db305a', 'e559e9a2-7a62-4c44-83c1-bed1dc8d99e6', 'f52c3419-227a-4edd-add3-ffd3eea75b9d'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:44:21.468349 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-0d9279ef-86d8-42a6-b6a3-de9f5e099905 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:44:21.474850 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-0d9279ef-86d8-42a6-b6a3-de9f5e099905 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:44:21.479462 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-0d9279ef-86d8-42a6-b6a3-de9f5e099905 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:44:21.538342 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-0d9279ef-86d8-42a6-b6a3-de9f5e099905 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:21.539089 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-0d9279ef-86d8-42a6-b6a3-de9f5e099905 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:21.548225 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d9279ef-86d8-42a6-b6a3-de9f5e099905 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Pushing event updated for resources: {'Port': ['ID=49a81388-ba4e-42e6-b643-dff0fadec9c5,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:21.578239 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-0d9279ef-86d8-42a6-b6a3-de9f5e099905 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8165286 Dec 09 14:44:21.604348 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Request body: {'port': {'device_id': 'ec116497-9e3b-4fda-8c28-119755d4df1c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:21.676723 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:21.803202 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f95f877f-5e40-4753-bdf0-11379aeb88be req-2e3782ca-6140-41ef-bd67-7adadf8f533e tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:21.805767 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f95f877f-5e40-4753-bdf0-11379aeb88be req-2e3782ca-6140-41ef-bd67-7adadf8f533e tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 931 time: 0.1003551 Dec 09 14:44:21.861677 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f95f877f-5e40-4753-bdf0-11379aeb88be req-4a40bb3d-c07f-443d-8e06-d9d6c6d48c1c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494225 Dec 09 14:44:21.922161 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-654e4f10-ed72-45a8-beee-7bc8d402e60c req-fc28c0db-2798-4f6d-9edf-a4a6ded65f91 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:21.923785 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-654e4f10-ed72-45a8-beee-7bc8d402e60c req-fc28c0db-2798-4f6d-9edf-a4a6ded65f91 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 950 time: 0.1399426 Dec 09 14:44:22.033348 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-654e4f10-ed72-45a8-beee-7bc8d402e60c req-ac350be3-a630-4309-acd4-6074ba9685bf tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/security-groups?id=a1327724-743a-4797-bc19-aa72c364eff4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1002386 Dec 09 14:44:22.160274 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 49a81388-ba4e-42e6-b643-dff0fadec9c5 {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:44:22.168835 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:22.193611 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Transition to ACTIVE for port object 49a81388-ba4e-42e6-b643-dff0fadec9c5 will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:44:22.207192 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:22.218513 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d2172cd-b639-4c05-b920-5db9dd7f5657 req-cbc0c87b-c70b-4f32-ba25-9f459d891eab tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:22.220397 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4d2172cd-b639-4c05-b920-5db9dd7f5657 req-cbc0c87b-c70b-4f32-ba25-9f459d891eab tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0642889 Dec 09 14:44:22.282113 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Pushing event updated for resources: {'Port': ['ID=49a81388-ba4e-42e6-b643-dff0fadec9c5,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:22.320391 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4d2172cd-b639-4c05-b920-5db9dd7f5657 req-2f2637da-a0de-4bd8-84e0-9b1f267ad17d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0938718 Dec 09 14:44:22.435720 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Attempting to bind port 49a81388-ba4e-42e6-b643-dff0fadec9c5 on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:44:22.439580 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Attempting to bind port 49a81388-ba4e-42e6-b643-dff0fadec9c5 by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:44:22.440100 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Attempting to bind port 49a81388-ba4e-42e6-b643-dff0fadec9c5 on network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:44:22.458209 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Port 49a81388-ba4e-42e6-b643-dff0fadec9c5 on network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:44:22.458545 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Attempting to bind port 49a81388-ba4e-42e6-b643-dff0fadec9c5 on network 99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:44:22.464407 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 44, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:44:22.464750 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Checking segment: {'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:44:22.465142 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Bound using segment: {'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:44:22.465577 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Bound port: 49a81388-ba4e-42e6-b643-dff0fadec9c5, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'f11d9e19-2d99-4f20-a186-cdaeddb729de', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 405, 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:44:22.465940 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:22.495899 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71d3aa06-2b3a-43db-9a86-779fa63271e6 req-72b6b409-5d97-4628-865c-dca251567566 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:22.504900 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-71d3aa06-2b3a-43db-9a86-779fa63271e6 req-72b6b409-5d97-4628-865c-dca251567566 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 950 time: 0.0718501 Dec 09 14:44:22.545743 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] For port 49a81388-ba4e-42e6-b643-dff0fadec9c5, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:44:22.549868 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] For port 49a81388-ba4e-42e6-b643-dff0fadec9c5, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=49a81388-ba4e-42e6-b643-dff0fadec9c5,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:44:22.556474 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:22.560985 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-71d3aa06-2b3a-43db-9a86-779fa63271e6 req-c6f8e2f5-ff18-45f9-a432-aa1e6fbb4acf tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/security-groups?id=a1327724-743a-4797-bc19-aa72c364eff4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0551910 Dec 09 14:44:22.611642 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:22.612262 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:22.614043 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] 10.222.0.44 "PUT /v2.0/ports/49a81388-ba4e-42e6-b643-dff0fadec9c5 HTTP/1.1" status: 200 len: 1093 time: 1.0176921 Dec 09 14:44:22.614518 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ec116497-9e3b-4fda-8c28-119755d4df1c', 'tag': '49a81388-ba4e-42e6-b643-dff0fadec9c5'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:44:22.617200 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-be886d05-465a-4b76-9abc-6faf62bc3f57" -d '{"events": [{"name": "network-changed", "server_uuid": "ec116497-9e3b-4fda-8c28-119755d4df1c", "tag": "49a81388-ba4e-42e6-b643-dff0fadec9c5"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:44:22.670682 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ea6b405-6588-46d3-8ed6-3c24b3d4260e service neutron] Pushing event updated for resources: {'Port': ['ID=49a81388-ba4e-42e6-b643-dff0fadec9c5,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:22.674776 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:44:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-754f07c5-bf98-4b3e-b9a8-d29b1e2f52f8 x-openstack-request-id: req-754f07c5-bf98-4b3e-b9a8-d29b1e2f52f8 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:44:22.675168 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ec116497-9e3b-4fda-8c28-119755d4df1c", "tag": "49a81388-ba4e-42e6-b643-dff0fadec9c5", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:44:22.675596 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-754f07c5-bf98-4b3e-b9a8-d29b1e2f52f8 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:44:22.676556 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ec116497-9e3b-4fda-8c28-119755d4df1c', 'tag': '49a81388-ba4e-42e6-b643-dff0fadec9c5', 'status': 'completed', 'code': 200} Dec 09 14:44:22.733033 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-ff5d299f-7571-4167-b06a-4aa929a29272 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:22.734788 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-ff5d299f-7571-4167-b06a-4aa929a29272 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=5ec989b7fd3e45f2b8962e012b0797ac&device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 1096 time: 0.0473413 Dec 09 14:44:22.797016 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-a996554e-3864-4fbf-b41e-ed1f73f746dd service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=49a81388-ba4e-42e6-b643-dff0fadec9c5 HTTP/1.1" status: 200 len: 217 time: 0.0366964 Dec 09 14:44:22.846264 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-9ab29670-93bf-471e-862b-a75d9fb0fc1c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:22.847794 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-9ab29670-93bf-471e-862b-a75d9fb0fc1c service neutron] 10.222.0.44 "GET /v2.0/subnets?id=7c6b4bb0-bfec-44d0-8503-70917540b3c5 HTTP/1.1" status: 200 len: 855 time: 0.0504415 Dec 09 14:44:22.886537 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-04e5d32b-f9b1-4a93-bf9d-9763e61271b8 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0278800 Dec 09 14:44:22.989082 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-347168a4-501a-491b-b6f3-e728631f9679 req-981bf2c0-8771-44d3-819d-2194469d21ec tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:22.990698 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-347168a4-501a-491b-b6f3-e728631f9679 req-981bf2c0-8771-44d3-819d-2194469d21ec tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 943 time: 0.0496521 Dec 09 14:44:23.008847 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-2f367802-0e85-4972-90d5-7a9b2c2391f2 service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0942910 Dec 09 14:44:23.043488 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-347168a4-501a-491b-b6f3-e728631f9679 req-143890c5-ab72-4529-803e-46af71de97fc tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457902 Dec 09 14:44:23.118176 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d50f55e6-d71b-4c2c-9e49-512c55ec3112 req-00928181-de3c-47e8-b7a7-bd09f510b6ba service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0948212 Dec 09 14:44:23.255989 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be886d05-465a-4b76-9abc-6faf62bc3f57 req-6d110ac2-2b03-441d-a30b-959fb726f7ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:23.257654 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-be886d05-465a-4b76-9abc-6faf62bc3f57 req-6d110ac2-2b03-441d-a30b-959fb726f7ca service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=5ec989b7fd3e45f2b8962e012b0797ac&device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 1096 time: 0.0468128 Dec 09 14:44:23.322915 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 55454) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:23.385092 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be886d05-465a-4b76-9abc-6faf62bc3f57 req-4c30b7d3-33d2-4b03-8cf5-64e5f0521e6b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:23.386723 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-be886d05-465a-4b76-9abc-6faf62bc3f57 req-4c30b7d3-33d2-4b03-8cf5-64e5f0521e6b service neutron] 10.222.0.44 "GET /v2.0/networks?id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d HTTP/1.1" status: 200 len: 916 time: 0.1009240 Dec 09 14:44:23.439658 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e2c7821-04a7-4459-bb94-f0a5ca0daed0 req-af5e08d2-3e93-4477-aa5e-147c28b449c3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:23.441159 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1e2c7821-04a7-4459-bb94-f0a5ca0daed0 req-af5e08d2-3e93-4477-aa5e-147c28b449c3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0526223 Dec 09 14:44:23.448513 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-be886d05-465a-4b76-9abc-6faf62bc3f57 req-dfdc5154-8012-40fb-836d-d0213ae319cf service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=49a81388-ba4e-42e6-b643-dff0fadec9c5 HTTP/1.1" status: 200 len: 217 time: 0.0414722 Dec 09 14:44:23.465383 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9fc91b4e-be38-4043-9618-1eefebb50c23 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:23.504592 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be886d05-465a-4b76-9abc-6faf62bc3f57 req-7b2e1c46-46b8-4b0a-b460-c091e0c59f5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:23.506163 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-be886d05-465a-4b76-9abc-6faf62bc3f57 req-7b2e1c46-46b8-4b0a-b460-c091e0c59f5a service neutron] 10.222.0.44 "GET /v2.0/subnets?id=7c6b4bb0-bfec-44d0-8503-70917540b3c5 HTTP/1.1" status: 200 len: 855 time: 0.0475650 Dec 09 14:44:23.512201 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1e2c7821-04a7-4459-bb94-f0a5ca0daed0 req-a7748279-fb58-4fff-82e1-dcc857b1f852 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0643094 Dec 09 14:44:23.563091 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-be886d05-465a-4b76-9abc-6faf62bc3f57 req-f0c466cf-b0c7-4836-a993-361eda499ddf service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0275681 Dec 09 14:44:23.569613 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9fc91b4e-be38-4043-9618-1eefebb50c23 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:23.574579 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9fc91b4e-be38-4043-9618-1eefebb50c23 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:23.616024 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-9fc91b4e-be38-4043-9618-1eefebb50c23 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=4dc91d73c2a44a08848f9261698d657d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2919486 Dec 09 14:44:23.616775 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 55464) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:23.617407 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9fc91b4e-be38-4043-9618-1eefebb50c23 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a935b3e6-f64e-41b0-8d0a-26e3669b34f5,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:23.699485 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2790700f-bda8-4e7a-b1db-8537644812c8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:23.705369 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-be886d05-465a-4b76-9abc-6faf62bc3f57 req-c64b6a27-dbe8-4b5a-afa4-02d45fa41a7a service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1016059 Dec 09 14:44:23.722283 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a1712aa-dc5c-4e00-a588-2931428ae339 req-7b8e1f10-6bc6-43a5-9493-53e588da4e51 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:23.723866 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7a1712aa-dc5c-4e00-a588-2931428ae339 req-7b8e1f10-6bc6-43a5-9493-53e588da4e51 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 950 time: 0.0712557 Dec 09 14:44:23.744762 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2790700f-bda8-4e7a-b1db-8537644812c8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:23.802835 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7a1712aa-dc5c-4e00-a588-2931428ae339 req-23347ed0-33aa-4140-b4ad-7ea4abba2288 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/security-groups?id=a1327724-743a-4797-bc19-aa72c364eff4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686491 Dec 09 14:44:23.819908 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-be886d05-465a-4b76-9abc-6faf62bc3f57 req-24daa75c-dfa7-43fc-84fc-9e1153d3b6b2 service neutron] 10.222.0.44 "GET /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1014915 Dec 09 14:44:23.829098 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2790700f-bda8-4e7a-b1db-8537644812c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:23.831688 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2790700f-bda8-4e7a-b1db-8537644812c8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:23.832811 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-2790700f-bda8-4e7a-b1db-8537644812c8 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/a935b3e6-f64e-41b0-8d0a-26e3669b34f5 HTTP/1.1" status: 204 len: 168 time: 0.2123191 Dec 09 14:44:23.840888 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2790700f-bda8-4e7a-b1db-8537644812c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a935b3e6-f64e-41b0-8d0a-26e3669b34f5,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:24.105184 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 55480) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:24.118476 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d0267cb0-0354-4efa-a415-68a9a3b31032 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:24.172067 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf9ef8e7-746f-4503-8ea8-8d361402a92b req-74bcabd7-8047-4625-a284-e649786f0b43 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:24.173951 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bf9ef8e7-746f-4503-8ea8-8d361402a92b req-74bcabd7-8047-4625-a284-e649786f0b43 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 943 time: 0.0573652 Dec 09 14:44:24.193008 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d0267cb0-0354-4efa-a415-68a9a3b31032 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:24.198260 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-d0267cb0-0354-4efa-a415-68a9a3b31032 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:24.223309 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bf9ef8e7-746f-4503-8ea8-8d361402a92b req-38183e44-3150-4355-a5cf-a3909f6ee206 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429759 Dec 09 14:44:24.235063 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0267cb0-0354-4efa-a415-68a9a3b31032 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f51fc60c-d0e8-4ec4-8126-b0c331c1c418,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:24.239623 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-d0267cb0-0354-4efa-a415-68a9a3b31032 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=aa01a410292f49fab9e84221329eb79a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1333685 Dec 09 14:44:24.245728 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 55482) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:24.294163 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f0477bfc-2a48-4a87-aad9-e3607a0ba2a5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:24.317566 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f0477bfc-2a48-4a87-aad9-e3607a0ba2a5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:24.365848 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f0477bfc-2a48-4a87-aad9-e3607a0ba2a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:24.368777 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f0477bfc-2a48-4a87-aad9-e3607a0ba2a5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:24.370267 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-f0477bfc-2a48-4a87-aad9-e3607a0ba2a5 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/f51fc60c-d0e8-4ec4-8126-b0c331c1c418 HTTP/1.1" status: 204 len: 168 time: 0.1236041 Dec 09 14:44:24.379735 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0477bfc-2a48-4a87-aad9-e3607a0ba2a5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f51fc60c-d0e8-4ec4-8126-b0c331c1c418,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:24.633768 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68b2065b-7f42-4337-ab33-f6b60847a008 req-6937107c-9089-43ce-9148-1788227e853b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:24.635177 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-68b2065b-7f42-4337-ab33-f6b60847a008 req-6937107c-9089-43ce-9148-1788227e853b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0485847 Dec 09 14:44:24.688306 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-68b2065b-7f42-4337-ab33-f6b60847a008 req-76f29f4b-148c-49b9-9e31-811bcab88a8e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0468688 Dec 09 14:44:24.928038 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4602589-26b1-4b68-8bc0-c57d5e703b88 req-06e5054d-479d-480b-a263-cef635cdb6de tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:24.929568 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f4602589-26b1-4b68-8bc0-c57d5e703b88 req-06e5054d-479d-480b-a263-cef635cdb6de tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 950 time: 0.0551126 Dec 09 14:44:24.993195 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f4602589-26b1-4b68-8bc0-c57d5e703b88 req-0db25b32-83e6-47ec-86c7-d500ee6d3e84 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/security-groups?id=a1327724-743a-4797-bc19-aa72c364eff4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538602 Dec 09 14:44:25.190091 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-148a155d-b742-4853-9681-32ed2822853a req-0145497a-def5-4f97-ad64-32fb29fba2d3 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:25.191541 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-148a155d-b742-4853-9681-32ed2822853a req-0145497a-def5-4f97-ad64-32fb29fba2d3 tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.44 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 950 time: 0.0548425 Dec 09 14:44:25.298334 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-148a155d-b742-4853-9681-32ed2822853a req-578f1e5e-940c-42a3-addf-d87306dfec0e tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Deleting port 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:44:25.298789 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-148a155d-b742-4853-9681-32ed2822853a req-578f1e5e-940c-42a3-addf-d87306dfec0e tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:25.354262 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8183ed8-208c-48b0-96a4-13606faad3cf req-23ab7fe2-8306-469b-9223-e3bb5069c580 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:25.357360 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f8183ed8-208c-48b0-96a4-13606faad3cf req-23ab7fe2-8306-469b-9223-e3bb5069c580 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 943 time: 0.0548096 Dec 09 14:44:25.403241 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-148a155d-b742-4853-9681-32ed2822853a req-578f1e5e-940c-42a3-addf-d87306dfec0e tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] For port 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=7fa5aa0e-36ee-4a3e-9313-65dc31bb2266,segment=NetworkSegment(f2938b2b-aa1e-4229-9424-41a0fb9d15c1),segment_id=f2938b2b-aa1e-4229-9424-41a0fb9d15c1)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:25.403843 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-148a155d-b742-4853-9681-32ed2822853a req-578f1e5e-940c-42a3-addf-d87306dfec0e tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:25.408911 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f8183ed8-208c-48b0-96a4-13606faad3cf req-d7268acb-36db-400e-bf17-2f8ba6976cec tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461709 Dec 09 14:44:25.418118 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-148a155d-b742-4853-9681-32ed2822853a req-578f1e5e-940c-42a3-addf-d87306dfec0e tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Calling delete_port for 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:44:25.567146 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-148a155d-b742-4853-9681-32ed2822853a req-578f1e5e-940c-42a3-addf-d87306dfec0e tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:25.586380 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['7fa5aa0e-36ee-4a3e-9313-65dc31bb2266'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:44:25.596133 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-578f1e5e-940c-42a3-addf-d87306dfec0e tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Pushing event deleted for resources: {'Port': ['ID=7fa5aa0e-36ee-4a3e-9313-65dc31bb2266,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:25.638774 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-148a155d-b742-4853-9681-32ed2822853a req-578f1e5e-940c-42a3-addf-d87306dfec0e tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] No DVR routers for this DVR port 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:44:25.641407 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-148a155d-b742-4853-9681-32ed2822853a req-578f1e5e-940c-42a3-addf-d87306dfec0e tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:25.644756 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-148a155d-b742-4853-9681-32ed2822853a req-578f1e5e-940c-42a3-addf-d87306dfec0e tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.44 "DELETE /v2.0/ports/7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 HTTP/1.1" status: 204 len: 173 time: 0.4446213 Dec 09 14:44:25.645397 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '9c22cb81-5912-4c52-933a-aba88e03e404', 'name': 'network-vif-deleted', 'tag': '7fa5aa0e-36ee-4a3e-9313-65dc31bb2266'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:44:25.648001 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aca0c0f9-754c-426e-8ca4-b0a7ec216154" -d '{"events": [{"server_uuid": "9c22cb81-5912-4c52-933a-aba88e03e404", "name": "network-vif-deleted", "tag": "7fa5aa0e-36ee-4a3e-9313-65dc31bb2266"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:44:25.687718 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:44:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7b9e1c49-d9fc-4d90-9337-8e3a84cf0718 x-openstack-request-id: req-7b9e1c49-d9fc-4d90-9337-8e3a84cf0718 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:44:25.688221 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "9c22cb81-5912-4c52-933a-aba88e03e404", "name": "network-vif-deleted", "tag": "7fa5aa0e-36ee-4a3e-9313-65dc31bb2266", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:44:25.688626 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-7b9e1c49-d9fc-4d90-9337-8e3a84cf0718 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:44:25.689187 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '9c22cb81-5912-4c52-933a-aba88e03e404', 'name': 'network-vif-deleted', 'tag': '7fa5aa0e-36ee-4a3e-9313-65dc31bb2266', 'status': 'completed', 'code': 200} Dec 09 14:44:25.834136 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9aaee56-d797-4279-ba4c-187a3f76857d req-5071a967-ce1b-447b-8a22-1a1f2c260ba6 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:25.835701 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c9aaee56-d797-4279-ba4c-187a3f76857d req-5071a967-ce1b-447b-8a22-1a1f2c260ba6 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0578744 Dec 09 14:44:25.892435 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c9aaee56-d797-4279-ba4c-187a3f76857d req-39305b6b-8141-4bb1-b428-960049571fb8 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0499666 Dec 09 14:44:26.110051 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e5c55591-b296-43b1-9461-ebf46dc188e7 req-7474dae1-9f60-4deb-b8bd-8511fda0283d tempest-VolumesNegativeTest-1919147216 tempest-VolumesNegativeTest-1919147216-project] 10.222.0.39 "GET /v2.0/ports?device_id=9c22cb81-5912-4c52-933a-aba88e03e404 HTTP/1.1" status: 200 len: 210 time: 0.0269289 Dec 09 14:44:26.460289 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 55600) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:26.529339 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75352ce9-b885-4ee6-946e-3840619e69da req-54bfadf6-e328-4642-a160-72f60ad21e7f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:26.531102 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-75352ce9-b885-4ee6-946e-3840619e69da req-54bfadf6-e328-4642-a160-72f60ad21e7f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 943 time: 0.0498500 Dec 09 14:44:26.569890 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-550072c5-4978-43af-82a1-da2edf7dedb9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:26.582922 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-75352ce9-b885-4ee6-946e-3840619e69da req-1cc14bda-a4bf-456b-b68f-c1d45cf73e2c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456245 Dec 09 14:44:26.664350 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-550072c5-4978-43af-82a1-da2edf7dedb9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:26.670385 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-550072c5-4978-43af-82a1-da2edf7dedb9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:26.844279 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 49a81388-ba4e-42e6-b643-dff0fadec9c5 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:44:26.940279 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-550072c5-4978-43af-82a1-da2edf7dedb9 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=bc91e29ecb2043e596eafc3df8910b35&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4790084 Dec 09 14:44:26.942953 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 55614) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:26.955176 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 49a81388-ba4e-42e6-b643-dff0fadec9c5, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=49a81388-ba4e-42e6-b643-dff0fadec9c5,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:26.964716 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-550072c5-4978-43af-82a1-da2edf7dedb9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=85d8fff8-5c5e-400a-877c-32048b249e1e,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:26.972665 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': '49a81388-ba4e-42e6-b643-dff0fadec9c5', 'network_id': '99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d', 'port_id': '49a81388-ba4e-42e6-b643-dff0fadec9c5', 'mac_address': 'fa:16:3e:76:00:09', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 405, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7c6b4bb0-bfec-44d0-8503-70917540b3c5', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:44:27.013924 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-84547716-48b2-4f8c-897a-1662d093675f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:27.022787 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f0c719c0-6048-448c-8274-7240a5405ac7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:27.038182 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-84547716-48b2-4f8c-897a-1662d093675f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:27.039747 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:27.051349 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5e49454-cc1a-4f9c-8094-e0a055aae560 req-834a0b07-d439-4ae4-9f9e-4d25ee71cb08 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:27.052720 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 49a81388-ba4e-42e6-b643-dff0fadec9c5 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:44:27.053086 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a5e49454-cc1a-4f9c-8094-e0a055aae560 req-834a0b07-d439-4ae4-9f9e-4d25ee71cb08 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0567913 Dec 09 14:44:27.077120 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 49a81388-ba4e-42e6-b643-dff0fadec9c5, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=49a81388-ba4e-42e6-b643-dff0fadec9c5,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:27.081949 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:27.096819 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-84547716-48b2-4f8c-897a-1662d093675f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:27.099519 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-84547716-48b2-4f8c-897a-1662d093675f admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:27.100766 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-84547716-48b2-4f8c-897a-1662d093675f admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/85d8fff8-5c5e-400a-877c-32048b249e1e HTTP/1.1" status: 204 len: 168 time: 0.1567836 Dec 09 14:44:27.108449 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a5e49454-cc1a-4f9c-8094-e0a055aae560 req-c70826c0-77d2-4ef0-8c8a-893b5749b936 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485218 Dec 09 14:44:27.112191 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84547716-48b2-4f8c-897a-1662d093675f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=85d8fff8-5c5e-400a-877c-32048b249e1e,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:27.147355 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=49a81388-ba4e-42e6-b643-dff0fadec9c5,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:27.489041 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['49a81388-ba4e-42e6-b643-dff0fadec9c5'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:44:27.700604 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1519eab-9c01-4c2c-919c-816e141ea518 req-4744c7d4-eab4-415d-aa39-9706b4ad387a tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:27.702072 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c1519eab-9c01-4c2c-919c-816e141ea518 req-4744c7d4-eab4-415d-aa39-9706b4ad387a tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 944 time: 0.0498879 Dec 09 14:44:27.754624 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c1519eab-9c01-4c2c-919c-816e141ea518 req-44873b3f-a73c-4352-96f8-658b544c506a tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462389 Dec 09 14:44:28.253954 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d15362d-01e4-43aa-bc97-7284364b3f85 req-609c13a6-79a6-4549-b083-6a3291b51b59 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:28.255675 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0d15362d-01e4-43aa-bc97-7284364b3f85 req-609c13a6-79a6-4549-b083-6a3291b51b59 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0536468 Dec 09 14:44:28.305632 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0d15362d-01e4-43aa-bc97-7284364b3f85 req-79bc5326-1dfa-48d6-ba6c-8999b47d4664 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435262 Dec 09 14:44:28.864428 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 49a81388-ba4e-42e6-b643-dff0fadec9c5 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:44:28.877220 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c95c44-fc90-4811-883b-ee34e254afc2 req-3ff0b82d-7142-47ac-8af0-5d30185d13fc tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:28.878806 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e6c95c44-fc90-4811-883b-ee34e254afc2 req-3ff0b82d-7142-47ac-8af0-5d30185d13fc tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 944 time: 0.0529699 Dec 09 14:44:28.915923 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port 49a81388-ba4e-42e6-b643-dff0fadec9c5 completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:44:28.920126 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port 49a81388-ba4e-42e6-b643-dff0fadec9c5 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:28.920495 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:28.928241 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e6c95c44-fc90-4811-883b-ee34e254afc2 req-dd650bd2-e3cf-4516-9a5f-9a11454bda7a tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430992 Dec 09 14:44:28.998964 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:29.020922 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ec116497-9e3b-4fda-8c28-119755d4df1c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '49a81388-ba4e-42e6-b643-dff0fadec9c5'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:44:29.023264 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-689a4281-3006-4fa9-8ba0-eee40e0f04db" -d '{"events": [{"server_uuid": "ec116497-9e3b-4fda-8c28-119755d4df1c", "name": "network-vif-plugged", "status": "completed", "tag": "49a81388-ba4e-42e6-b643-dff0fadec9c5"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:44:29.039038 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 49a81388-ba4e-42e6-b643-dff0fadec9c5, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=49a81388-ba4e-42e6-b643-dff0fadec9c5,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:29.045029 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:29.045815 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:44:29.066512 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:44:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d924db76-3c74-4522-ad2f-bf6182534cc1 x-openstack-request-id: req-d924db76-3c74-4522-ad2f-bf6182534cc1 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:44:29.066812 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ec116497-9e3b-4fda-8c28-119755d4df1c", "name": "network-vif-plugged", "status": "completed", "tag": "49a81388-ba4e-42e6-b643-dff0fadec9c5", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:44:29.067071 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-d924db76-3c74-4522-ad2f-bf6182534cc1 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:44:29.067478 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ec116497-9e3b-4fda-8c28-119755d4df1c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '49a81388-ba4e-42e6-b643-dff0fadec9c5', 'code': 200} Dec 09 14:44:29.083703 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:44:29.084052 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 7fa5aa0e-36ee-4a3e-9313-65dc31bb2266 not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:44:29.110524 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=49a81388-ba4e-42e6-b643-dff0fadec9c5,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:29.175313 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5be16a5d-3213-4ca7-9fe6-efbee2eae451 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:29.279298 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d5ade39-38d7-474e-8977-7fac3d251a93 req-22e00739-aa41-4193-ac72-09943b2847db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:29.280889 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6d5ade39-38d7-474e-8977-7fac3d251a93 req-22e00739-aa41-4193-ac72-09943b2847db service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 1098 time: 0.0558462 Dec 09 14:44:29.333255 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6d5ade39-38d7-474e-8977-7fac3d251a93 req-70849fd2-52ef-478d-8b49-9af47d0fb4f0 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420284 Dec 09 14:44:29.432509 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2eccefcb-c52d-46c9-ad06-f4d60375bf19 req-94c5fe3c-9e13-4f9f-9ea1-2d31670b1cfd tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:29.434081 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2eccefcb-c52d-46c9-ad06-f4d60375bf19 req-94c5fe3c-9e13-4f9f-9ea1-2d31670b1cfd tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0560586 Dec 09 14:44:29.481298 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2eccefcb-c52d-46c9-ad06-f4d60375bf19 req-d6006bcb-7ed0-4759-b37a-681310faf6a2 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410833 Dec 09 14:44:30.053772 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fe1fc2e-4b23-4529-bf25-b5a49c0f0d9f req-24fbc073-5794-4391-8cf4-bc9a0994fdf6 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:30.056474 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0fe1fc2e-4b23-4529-bf25-b5a49c0f0d9f req-24fbc073-5794-4391-8cf4-bc9a0994fdf6 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 945 time: 0.0557191 Dec 09 14:44:30.124820 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0fe1fc2e-4b23-4529-bf25-b5a49c0f0d9f req-e46a481a-1835-4efe-be3b-ca51c7f04451 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0577025 Dec 09 14:44:30.419155 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:30.602382 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54adb2b6-aaba-4fe8-9410-5c2277d42881 req-5f03b29f-3ae2-4e01-bffe-74d672c39227 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:30.603969 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-54adb2b6-aaba-4fe8-9410-5c2277d42881 req-5f03b29f-3ae2-4e01-bffe-74d672c39227 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0521796 Dec 09 14:44:30.657404 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-54adb2b6-aaba-4fe8-9410-5c2277d42881 req-410f14f7-c003-4342-b253-bf86103f3665 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474610 Dec 09 14:44:31.248563 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fd3efd0-abff-4601-8c09-8d65c88e6f4c req-9886d5d1-ae23-4d5b-ad6b-d25115dc3bdf tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:31.250081 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7fd3efd0-abff-4601-8c09-8d65c88e6f4c req-9886d5d1-ae23-4d5b-ad6b-d25115dc3bdf tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 945 time: 0.0503871 Dec 09 14:44:31.299508 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7fd3efd0-abff-4601-8c09-8d65c88e6f4c req-89d0a8e1-2d76-4bc1-8e64-670f732e8c95 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432281 Dec 09 14:44:31.776318 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22705c37-aca5-4b55-b04c-c5d7fb1a10fd req-3177753c-ff75-4bae-8d13-e1b05d7fabea tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:31.778283 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-22705c37-aca5-4b55-b04c-c5d7fb1a10fd req-3177753c-ff75-4bae-8d13-e1b05d7fabea tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0526061 Dec 09 14:44:31.797990 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:31.829221 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-22705c37-aca5-4b55-b04c-c5d7fb1a10fd req-41efa714-18ee-4b48-8024-9d0563bd8a14 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445573 Dec 09 14:44:32.635599 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:32.983091 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51afb029-5f69-474b-a60a-56537e06e26f req-a6258df2-dae9-4a76-9ccf-a918befa39d5 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:32.984813 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51afb029-5f69-474b-a60a-56537e06e26f req-a6258df2-dae9-4a76-9ccf-a918befa39d5 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0540271 Dec 09 14:44:33.035327 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-51afb029-5f69-474b-a60a-56537e06e26f req-b877f63a-a80a-45b6-b9c2-f58721da25f0 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437369 Dec 09 14:44:33.245517 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c3041ac-bc9a-421c-900c-02f2ecea7bbc req-c9cc8ffe-b31c-494c-b6ff-69874f26d4d3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:33.246984 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8c3041ac-bc9a-421c-900c-02f2ecea7bbc req-c9cc8ffe-b31c-494c-b6ff-69874f26d4d3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0490506 Dec 09 14:44:33.293831 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8c3041ac-bc9a-421c-900c-02f2ecea7bbc req-cdd59262-f375-46dc-b880-9e7a793fa54b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406413 Dec 09 14:44:33.757682 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 55990) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:33.893390 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-37dc0303-b786-47f4-b5d7-252766ecbaf5 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=8d276344db394d60b4fc283713bf252e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1341784 Dec 09 14:44:33.896010 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 55994) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:33.946848 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-9c8b40b5-a9f3-46c4-84cf-da56217a79ab admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:33.968787 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-9c8b40b5-a9f3-46c4-84cf-da56217a79ab admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:34.020723 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-9c8b40b5-a9f3-46c4-84cf-da56217a79ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:34.023508 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-9c8b40b5-a9f3-46c4-84cf-da56217a79ab admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:34.024806 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-9c8b40b5-a9f3-46c4-84cf-da56217a79ab admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/a1327724-743a-4797-bc19-aa72c364eff4 HTTP/1.1" status: 204 len: 168 time: 0.1276150 Dec 09 14:44:34.040908 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c8b40b5-a9f3-46c4-84cf-da56217a79ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a1327724-743a-4797-bc19-aa72c364eff4,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:34.154814 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9719326a-fecc-4f79-bc27-517f26841c8a req-cb7208c8-ed57-4af6-a53d-fac6062c347b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:34.156522 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9719326a-fecc-4f79-bc27-517f26841c8a req-cb7208c8-ed57-4af6-a53d-fac6062c347b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0507948 Dec 09 14:44:34.209120 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9719326a-fecc-4f79-bc27-517f26841c8a req-59f78d97-9f7c-4f93-8d41-1b4d8519b25c tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457034 Dec 09 14:44:34.426682 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb9f0f24-f738-4026-9dd0-5b0c1303e11e req-d0d1bb02-86b3-4f91-a0a5-62cfb28e9a32 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:34.428187 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-cb9f0f24-f738-4026-9dd0-5b0c1303e11e req-d0d1bb02-86b3-4f91-a0a5-62cfb28e9a32 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0572846 Dec 09 14:44:34.475318 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-cb9f0f24-f738-4026-9dd0-5b0c1303e11e req-2aae1060-c534-4ea6-904f-90485af9f871 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410492 Dec 09 14:44:35.331639 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f809fa4-10d5-47eb-8fa6-bb2da5013191 req-e59de5b8-b36c-4f3a-910e-fbd5c44e3448 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:35.333171 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3f809fa4-10d5-47eb-8fa6-bb2da5013191 req-e59de5b8-b36c-4f3a-910e-fbd5c44e3448 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0552840 Dec 09 14:44:35.384046 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3f809fa4-10d5-47eb-8fa6-bb2da5013191 req-610d16dc-0539-4180-89de-7f5c5dd0aede tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446837 Dec 09 14:44:35.617976 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f692b55d-3105-45fc-bad2-8bba4ea9afc9 req-a4336ab8-97d1-472d-b38e-ef320c38fceb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:35.619675 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f692b55d-3105-45fc-bad2-8bba4ea9afc9 req-a4336ab8-97d1-472d-b38e-ef320c38fceb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0580914 Dec 09 14:44:35.666329 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f692b55d-3105-45fc-bad2-8bba4ea9afc9 req-de82d84d-7177-42e4-92e5-a26b3156353a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406582 Dec 09 14:44:36.505302 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-fef873ed-3b0e-4b85-8f27-cf7ba3d03400 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-999339417&fields=id&tenant_id=10d73d0acf44499e88f6d53847b2094e HTTP/1.1" status: 200 len: 267 time: 0.0458522 Dec 09 14:44:36.508544 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36c90bd8-46f2-4128-ae89-6a6a719d7fb3 req-52cc582b-bad5-4c89-98bb-7f3d7e9d11ba tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:36.510116 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-36c90bd8-46f2-4128-ae89-6a6a719d7fb3 req-52cc582b-bad5-4c89-98bb-7f3d7e9d11ba tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0489860 Dec 09 14:44:36.560341 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-36c90bd8-46f2-4128-ae89-6a6a719d7fb3 req-4a2b8a15-769c-4fe2-9bb1-fd424e10804e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443292 Dec 09 14:44:36.617073 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-97da6413-bf56-4fc2-a398-189d3d4b6c8a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:36.618454 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-97da6413-bf56-4fc2-a398-189d3d4b6c8a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/networks?id=f0982548-601b-4206-88dc-a16a0317b421 HTTP/1.1" status: 200 len: 808 time: 0.1056678 Dec 09 14:44:36.633533 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-f1e7a6b3-7ed8-483f-a4fe-fd96f53c39e4 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/quotas/10d73d0acf44499e88f6d53847b2094e HTTP/1.1" status: 200 len: 375 time: 0.0090225 Dec 09 14:44:36.685597 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-c9830fa2-8883-478b-962b-b8637d40a84a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=10d73d0acf44499e88f6d53847b2094e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0468998 Dec 09 14:44:36.781767 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-2986aa4c-36e6-4d74-9dd7-e385f8cf29a7 service neutron] 10.222.0.39 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837719 Dec 09 14:44:36.787864 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4b25e9a-71d0-4dc8-8998-7ed65fd584dd req-76811d9d-1d55-43db-8d2b-48ef25678500 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:36.789480 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a4b25e9a-71d0-4dc8-8998-7ed65fd584dd req-76811d9d-1d55-43db-8d2b-48ef25678500 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0475445 Dec 09 14:44:36.836654 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a4b25e9a-71d0-4dc8-8998-7ed65fd584dd req-49020863-a3e6-4583-9b59-64dcc799396d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413520 Dec 09 14:44:36.877108 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-bb714ceb-9c45-4fba-a42f-bf02016e0ed7 service neutron] 10.222.0.39 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889165 Dec 09 14:44:37.187354 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f22599b7-d25d-4c53-a8a7-90cd62dd812e req-86a01cc6-498c-4627-99dd-09846b2cc747 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 210 time: 0.0339959 Dec 09 14:44:37.688959 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1244e231-9677-47ea-968c-8e682ba1f641 req-a2f55ed8-44fc-49aa-b7f8-8f362d3a1ca9 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:37.690420 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1244e231-9677-47ea-968c-8e682ba1f641 req-a2f55ed8-44fc-49aa-b7f8-8f362d3a1ca9 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0492477 Dec 09 14:44:37.740334 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1244e231-9677-47ea-968c-8e682ba1f641 req-f653d81c-1c89-4234-a158-9847948a3cc3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438123 Dec 09 14:44:37.966901 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b307b84f-d8d0-4797-8835-77d2b851b11f req-8105ef3f-ac27-4516-bdab-d931fb5c03ab tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:37.968351 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b307b84f-d8d0-4797-8835-77d2b851b11f req-8105ef3f-ac27-4516-bdab-d931fb5c03ab tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0566380 Dec 09 14:44:38.017564 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b307b84f-d8d0-4797-8835-77d2b851b11f req-a9c38a53-c88d-4f0b-8b82-a1d691b882d0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430710 Dec 09 14:44:38.282149 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7880a75b-3112-478a-8264-271eaebe4474 req-32707474-4d8f-4bec-9692-0212089b5ca2 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 210 time: 0.0259264 Dec 09 14:44:38.413021 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-f065bf2c-2878-4c3c-9911-55c1edee06e9 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:38.414490 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-f065bf2c-2878-4c3c-9911-55c1edee06e9 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.44 "GET /v2.0/networks?id=f0982548-601b-4206-88dc-a16a0317b421 HTTP/1.1" status: 200 len: 808 time: 0.1138353 Dec 09 14:44:38.537132 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-1c21d6fd-c1e2-43d8-b334-aa02e28ab9d1 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.44 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=10d73d0acf44499e88f6d53847b2094e HTTP/1.1" status: 200 len: 379 time: 0.0601017 Dec 09 14:44:38.552173 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Request body: {'port': {'device_id': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'admin_state_up': True, 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'security_groups': ['15ffbd79-f4ea-441f-8956-2c10355c90c0']}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:38.667420 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Made reservation on behalf of 10d73d0acf44499e88f6d53847b2094e for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:44:38.671736 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:38.798955 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Allocated IP 172.20.0.6 (f0982548-601b-4206-88dc-a16a0317b421/7edf1e5e-d953-4e3c-8dc5-29475e258db2/e44baa3b-39d9-4337-9599-d357f2381c7d) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:44:38.859797 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3b5d8c-3025-4a25-ab4e-79abf375b5bb req-beb8118c-b0aa-4963-b4e2-74904f1bdcc1 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:38.861280 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-de3b5d8c-3025-4a25-ab4e-79abf375b5bb req-beb8118c-b0aa-4963-b4e2-74904f1bdcc1 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0479932 Dec 09 14:44:38.910393 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-de3b5d8c-3025-4a25-ab4e-79abf375b5bb req-62ca5b8c-45fc-4078-a65a-b9b8e6471b14 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429032 Dec 09 14:44:38.943264 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:38.980665 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:39.021617 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Network f0982548-601b-4206-88dc-a16a0317b421 is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:44:39.026483 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:44:39.030042 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:44:39.036444 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Pushing event updated for resources: {'Port': ['ID=e44baa3b-39d9-4337-9599-d357f2381c7d,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:39.066461 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:39.066820 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:39.067221 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:39.067530 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:39.069638 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:39.069638 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:39.069638 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:39.069638 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:39.069638 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:39.069638 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:39.070217 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:39.070217 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:39.070604 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:39.102930 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:39.103592 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:39.133356 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-d5902d31-97a4-449b-9923-66a0204325c0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5848389 Dec 09 14:44:39.156832 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Request body: {'port': {'device_id': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:39.204553 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1d4eafc-a9ee-438e-a822-69d6cce9430e req-c4f470c0-3195-41e5-882c-3b7ef18cb73a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:39.206122 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1d4eafc-a9ee-438e-a822-69d6cce9430e req-c4f470c0-3195-41e5-882c-3b7ef18cb73a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0876842 Dec 09 14:44:39.271036 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:39.319791 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-840bc5f3-c2d6-4019-9eb4-89ca72d985c3 None None] Provisioning complete for port e44baa3b-39d9-4337-9599-d357f2381c7d triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:39.320279 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-840bc5f3-c2d6-4019-9eb4-89ca72d985c3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:39.363921 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-840bc5f3-c2d6-4019-9eb4-89ca72d985c3 None None] Port e44baa3b-39d9-4337-9599-d357f2381c7d cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:44:39.419235 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34a3f42b-2bbf-4802-915b-4e08761519b5 req-1a544dc7-60e6-4a7d-892a-226c89f688cd tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:39.420910 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-34a3f42b-2bbf-4802-915b-4e08761519b5 req-1a544dc7-60e6-4a7d-892a-226c89f688cd tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 931 time: 0.0518200 Dec 09 14:44:39.482668 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-34a3f42b-2bbf-4802-915b-4e08761519b5 req-66bb0a6d-79b2-4734-a681-58c36026cf90 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0540111 Dec 09 14:44:39.586774 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d4a24e1-7e8f-429a-8fe1-e3c086415388 req-1421da1f-f4d4-4f0a-961c-8a0900bb3852 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:39.588358 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3d4a24e1-7e8f-429a-8fe1-e3c086415388 req-1421da1f-f4d4-4f0a-961c-8a0900bb3852 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 1098 time: 0.3672507 Dec 09 14:44:39.595502 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b1d4eafc-a9ee-438e-a822-69d6cce9430e req-141ed372-b736-40f6-866d-a79f56dafdaa tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3714843 Dec 09 14:44:39.747465 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3d4a24e1-7e8f-429a-8fe1-e3c086415388 req-e3c3bfa2-06ab-4689-96f0-63e352312887 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0957942 Dec 09 14:44:39.848401 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e44baa3b-39d9-4337-9599-d357f2381c7d {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:44:39.856251 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:39.869287 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Transition to ACTIVE for port object e44baa3b-39d9-4337-9599-d357f2381c7d will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:44:39.876606 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:39.924157 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Pushing event updated for resources: {'Port': ['ID=e44baa3b-39d9-4337-9599-d357f2381c7d,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:40.031213 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Attempting to bind port e44baa3b-39d9-4337-9599-d357f2381c7d on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:44:40.032219 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Attempting to bind port e44baa3b-39d9-4337-9599-d357f2381c7d by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': 'a2b92707-4465-4444-9285-42fd2c8881e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:44:40.032740 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Attempting to bind port e44baa3b-39d9-4337-9599-d357f2381c7d on network f0982548-601b-4206-88dc-a16a0317b421 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:44:40.040218 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Port e44baa3b-39d9-4337-9599-d357f2381c7d on network f0982548-601b-4206-88dc-a16a0317b421 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:44:40.040551 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Attempting to bind port e44baa3b-39d9-4337-9599-d357f2381c7d on network f0982548-601b-4206-88dc-a16a0317b421 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:44:40.048624 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 44, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:44:40.048975 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Checking segment: {'id': 'a2b92707-4465-4444-9285-42fd2c8881e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:44:40.049372 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Bound using segment: {'id': 'a2b92707-4465-4444-9285-42fd2c8881e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:44:40.049813 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Bound port: e44baa3b-39d9-4337-9599-d357f2381c7d, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a2b92707-4465-4444-9285-42fd2c8881e1', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 449, 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:44:40.050180 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:40.060930 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98ab9d92-6f97-4d43-a4c7-a724a420a9a5 req-bce3f4d2-ce6b-4197-ab3e-a39ce52ac561 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:40.062676 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-98ab9d92-6f97-4d43-a4c7-a724a420a9a5 req-bce3f4d2-ce6b-4197-ab3e-a39ce52ac561 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0758843 Dec 09 14:44:40.158388 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-98ab9d92-6f97-4d43-a4c7-a724a420a9a5 req-645e9057-a16c-4277-a56b-6373fa00c0d9 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0889916 Dec 09 14:44:40.166413 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] For port e44baa3b-39d9-4337-9599-d357f2381c7d, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:44:40.170041 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] For port e44baa3b-39d9-4337-9599-d357f2381c7d, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=e44baa3b-39d9-4337-9599-d357f2381c7d,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:44:40.177537 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:40.227219 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:40.228054 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:40.229446 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] 10.222.0.44 "PUT /v2.0/ports/e44baa3b-39d9-4337-9599-d357f2381c7d HTTP/1.1" status: 200 len: 1093 time: 1.0784419 Dec 09 14:44:40.229890 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'tag': 'e44baa3b-39d9-4337-9599-d357f2381c7d'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:44:40.232243 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-25443d82-67db-4e0b-afdb-2341152d5cad" -d '{"events": [{"name": "network-changed", "server_uuid": "fb81e6b3-1e55-4186-be5b-5f51f6563593", "tag": "e44baa3b-39d9-4337-9599-d357f2381c7d"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:44:40.261657 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-142bd987-eba0-497d-b8d1-377ad262f494 service neutron] Pushing event updated for resources: {'Port': ['ID=e44baa3b-39d9-4337-9599-d357f2381c7d,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:40.302311 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:44:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a1175145-9a51-4139-b2ae-a701050cf2f4 x-openstack-request-id: req-a1175145-9a51-4139-b2ae-a701050cf2f4 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:44:40.302614 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fb81e6b3-1e55-4186-be5b-5f51f6563593", "tag": "e44baa3b-39d9-4337-9599-d357f2381c7d", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:44:40.302885 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-a1175145-9a51-4139-b2ae-a701050cf2f4 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:44:40.303252 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'tag': 'e44baa3b-39d9-4337-9599-d357f2381c7d', 'status': 'completed', 'code': 200} Dec 09 14:44:40.321721 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-a3db06b7-5cb2-4839-9b7f-49eef0546d24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:40.323255 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-a3db06b7-5cb2-4839-9b7f-49eef0546d24 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=10d73d0acf44499e88f6d53847b2094e&device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 1096 time: 0.0479367 Dec 09 14:44:40.385590 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-8bb32930-24de-4f4d-90f1-978d0fdb2189 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e44baa3b-39d9-4337-9599-d357f2381c7d HTTP/1.1" status: 200 len: 217 time: 0.0377319 Dec 09 14:44:40.435527 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:44:40.455541 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-b582968e-6b19-415a-acc7-e39fae2f274c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:40.458305 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-b582968e-6b19-415a-acc7-e39fae2f274c service neutron] 10.222.0.44 "GET /v2.0/subnets?id=7edf1e5e-d953-4e3c-8dc5-29475e258db2 HTTP/1.1" status: 200 len: 847 time: 0.0553186 Dec 09 14:44:40.529402 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-ad53d0bc-9e8f-435e-b648-1bb5151e48ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:40.534304 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-ad53d0bc-9e8f-435e-b648-1bb5151e48ba service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=f0982548-601b-4206-88dc-a16a0317b421&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0454123 Dec 09 14:44:40.673011 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-936a9a8b-4e52-4cae-bf29-8c4ae49c9674 req-9a28e7ee-d839-4e85-a89a-61882ae7413e tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:40.674634 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-936a9a8b-4e52-4cae-bf29-8c4ae49c9674 req-9a28e7ee-d839-4e85-a89a-61882ae7413e tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 943 time: 0.0912349 Dec 09 14:44:40.678612 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-4341f9b8-e439-4051-b1f8-146d913d3dc9 service neutron] 10.222.0.44 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1387615 Dec 09 14:44:40.787928 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-936a9a8b-4e52-4cae-bf29-8c4ae49c9674 req-818ee14b-c233-4633-8ae0-3e627159ace8 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1029437 Dec 09 14:44:40.835191 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e8ee9427-0ef5-4a53-97cb-0ace7c92432c req-bb472d07-e84b-47d2-b12d-005190551298 service neutron] 10.222.0.44 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1356516 Dec 09 14:44:40.922892 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-481ad40f-4bef-4864-bc1a-68b1adb1cdf7 req-42130715-d41f-48c5-aa8f-afdbfbcf469c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:40.924382 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-481ad40f-4bef-4864-bc1a-68b1adb1cdf7 req-42130715-d41f-48c5-aa8f-afdbfbcf469c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0677648 Dec 09 14:44:41.001719 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-481ad40f-4bef-4864-bc1a-68b1adb1cdf7 req-8be6f592-023a-41b6-8e2c-3a84aee9d8c3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0710819 Dec 09 14:44:41.005751 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25443d82-67db-4e0b-afdb-2341152d5cad req-3d49bea8-7a4b-4a8d-b54a-8ecdcb77170f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:41.007441 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-25443d82-67db-4e0b-afdb-2341152d5cad req-3d49bea8-7a4b-4a8d-b54a-8ecdcb77170f service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=10d73d0acf44499e88f6d53847b2094e&device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 1096 time: 0.0699193 Dec 09 14:44:41.112463 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25443d82-67db-4e0b-afdb-2341152d5cad req-3440a156-46bb-41bc-b10e-ff865665abdb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:41.114063 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-25443d82-67db-4e0b-afdb-2341152d5cad req-3440a156-46bb-41bc-b10e-ff865665abdb service neutron] 10.222.0.44 "GET /v2.0/networks?id=f0982548-601b-4206-88dc-a16a0317b421 HTTP/1.1" status: 200 len: 909 time: 0.0909297 Dec 09 14:44:41.158839 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-25443d82-67db-4e0b-afdb-2341152d5cad req-a1d8bb22-5af2-4120-9eec-fc51467dfb4c service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e44baa3b-39d9-4337-9599-d357f2381c7d HTTP/1.1" status: 200 len: 217 time: 0.0345840 Dec 09 14:44:41.213198 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25443d82-67db-4e0b-afdb-2341152d5cad req-9067ea39-f55e-40b8-b4d0-999816a149e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:41.215265 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-25443d82-67db-4e0b-afdb-2341152d5cad req-9067ea39-f55e-40b8-b4d0-999816a149e7 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=7edf1e5e-d953-4e3c-8dc5-29475e258db2 HTTP/1.1" status: 200 len: 847 time: 0.0455172 Dec 09 14:44:41.298667 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25443d82-67db-4e0b-afdb-2341152d5cad req-c69d4082-948a-4391-a0ce-2d736ece36ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:41.300279 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-25443d82-67db-4e0b-afdb-2341152d5cad req-c69d4082-948a-4391-a0ce-2d736ece36ca service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=f0982548-601b-4206-88dc-a16a0317b421&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0744874 Dec 09 14:44:41.308932 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aecb2c85-4df2-43d9-a794-3ac5cddcd2b9 req-1aec7d98-cead-406e-a826-ae4e58fcd0bc tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:41.310379 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-aecb2c85-4df2-43d9-a794-3ac5cddcd2b9 req-1aec7d98-cead-406e-a826-ae4e58fcd0bc tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0761046 Dec 09 14:44:41.418146 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-aecb2c85-4df2-43d9-a794-3ac5cddcd2b9 req-717dc2e7-2636-472b-b64d-f418ba1c5118 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1006494 Dec 09 14:44:41.447042 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-25443d82-67db-4e0b-afdb-2341152d5cad req-8d8c6f56-97e5-4367-a4e0-9f0f0469aa5c service neutron] 10.222.0.44 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1223934 Dec 09 14:44:41.556453 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-25443d82-67db-4e0b-afdb-2341152d5cad req-348a521a-d0c3-4caa-a27d-7c762250a5dd service neutron] 10.222.0.44 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0958359 Dec 09 14:44:41.908164 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf30ba07-73a8-42ae-9042-02e1f8f3d5c8 req-427a109f-f5da-4cb2-9d1f-937b1928b8fd tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:41.909608 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-bf30ba07-73a8-42ae-9042-02e1f8f3d5c8 req-427a109f-f5da-4cb2-9d1f-937b1928b8fd tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 943 time: 0.0505495 Dec 09 14:44:41.959511 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-bf30ba07-73a8-42ae-9042-02e1f8f3d5c8 req-86e44eea-95c9-4b51-a83e-ffba7b19ed3c tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438993 Dec 09 14:44:42.132448 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a24bd2ca-1133-400c-b700-035512c1c4e9 req-c9cc1c5c-fdf4-4b6d-aeca-cba0450e8920 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:42.133998 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a24bd2ca-1133-400c-b700-035512c1c4e9 req-c9cc1c5c-fdf4-4b6d-aeca-cba0450e8920 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0559475 Dec 09 14:44:42.184017 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a24bd2ca-1133-400c-b700-035512c1c4e9 req-e9f13085-0cb2-4627-bec1-3bf889d3c969 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419190 Dec 09 14:44:42.537636 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaa59131-b327-4e77-be7e-f0c8160224ec req-2bc32d34-fefc-4460-8032-9b4774c5422f tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:42.539122 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-aaa59131-b327-4e77-be7e-f0c8160224ec req-2bc32d34-fefc-4460-8032-9b4774c5422f tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0509117 Dec 09 14:44:42.595467 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-aaa59131-b327-4e77-be7e-f0c8160224ec req-3ca92648-74f5-48ee-8f01-b47a91dc6429 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475581 Dec 09 14:44:42.842135 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a986ec5-b1b1-460d-b068-eb9aee27001c req-2249cbd9-dc50-4a30-8e9b-c37cbaefa6c4 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:42.843641 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7a986ec5-b1b1-460d-b068-eb9aee27001c req-2249cbd9-dc50-4a30-8e9b-c37cbaefa6c4 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0507548 Dec 09 14:44:42.845308 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b48cab2-7496-4a5e-af8c-357e55e6eb27 req-f1b58a36-b5fb-40df-88f3-ad46c8e05ba4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:42.846836 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3b48cab2-7496-4a5e-af8c-357e55e6eb27 req-f1b58a36-b5fb-40df-88f3-ad46c8e05ba4 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=3d298e3ebec54c2281ddf8bbb50b7cea&device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 1098 time: 0.0416193 Dec 09 14:44:42.889926 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7a986ec5-b1b1-460d-b068-eb9aee27001c req-45007a52-924d-4cef-94ac-09a6f6fcf696 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403080 Dec 09 14:44:42.939286 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b48cab2-7496-4a5e-af8c-357e55e6eb27 req-47b8f869-a289-42af-ac01-14bf1217882f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:42.940774 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3b48cab2-7496-4a5e-af8c-357e55e6eb27 req-47b8f869-a289-42af-ac01-14bf1217882f service neutron] 10.222.0.44 "GET /v2.0/networks?id=8ff38a1e-5122-4806-8b7d-d4c281cbe550 HTTP/1.1" status: 200 len: 919 time: 0.0829673 Dec 09 14:44:43.005393 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3b48cab2-7496-4a5e-af8c-357e55e6eb27 req-688e847c-4973-42d5-a3f3-f709308ca1bc service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=bb290a6d-709a-49d1-bd2e-10c0fe664657 HTTP/1.1" status: 200 len: 217 time: 0.0393093 Dec 09 14:44:43.088849 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b48cab2-7496-4a5e-af8c-357e55e6eb27 req-0962079a-66ba-4791-b791-61308e56e593 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:43.090364 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3b48cab2-7496-4a5e-af8c-357e55e6eb27 req-0962079a-66ba-4791-b791-61308e56e593 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=90388423-2d07-4cbe-80d8-fa2f6a3c14f7 HTTP/1.1" status: 200 len: 858 time: 0.0741808 Dec 09 14:44:43.113172 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07f4c33f-8696-44bc-a888-2b3073cfe914 req-f5e7ed93-7161-48bc-b438-00a346c5f00f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:43.114638 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-07f4c33f-8696-44bc-a888-2b3073cfe914 req-f5e7ed93-7161-48bc-b438-00a346c5f00f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 943 time: 0.0683689 Dec 09 14:44:43.135025 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3b48cab2-7496-4a5e-af8c-357e55e6eb27 req-3c10c856-55b1-4596-8316-363b10c3f176 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=8ff38a1e-5122-4806-8b7d-d4c281cbe550&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0369761 Dec 09 14:44:43.229316 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-07f4c33f-8696-44bc-a888-2b3073cfe914 req-cf2df139-8de8-4b27-aa7d-b99ae2869726 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0965114 Dec 09 14:44:43.284676 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3b48cab2-7496-4a5e-af8c-357e55e6eb27 req-d26aea80-6b0b-4695-a37b-de64f3708fbc service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1371293 Dec 09 14:44:43.297253 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29df3a0e-ea44-4cfb-b698-27735510d467 req-13cfb4a6-a981-4642-bea3-33aafddbf25b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:43.298861 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-29df3a0e-ea44-4cfb-b698-27735510d467 req-13cfb4a6-a981-4642-bea3-33aafddbf25b service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=6be5d78d2d0049448c3947b4e650758a&device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 1099 time: 0.0590961 Dec 09 14:44:43.332931 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6024d0f7-9328-477e-9cda-787b7780d257 req-75df9665-e454-413d-b411-fb0888d70b56 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:43.334573 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6024d0f7-9328-477e-9cda-787b7780d257 req-75df9665-e454-413d-b411-fb0888d70b56 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0567222 Dec 09 14:44:43.386149 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6024d0f7-9328-477e-9cda-787b7780d257 req-b9a554d0-78d8-4a45-8cc8-fad3d20d012b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449703 Dec 09 14:44:43.464434 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3b48cab2-7496-4a5e-af8c-357e55e6eb27 req-6a048b51-8831-477d-82bc-293fad084c5f service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1646087 Dec 09 14:44:43.474816 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29df3a0e-ea44-4cfb-b698-27735510d467 req-7cd9a6cb-db84-4db3-898a-1b4a4d3276a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:43.476327 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-29df3a0e-ea44-4cfb-b698-27735510d467 req-7cd9a6cb-db84-4db3-898a-1b4a4d3276a9 service neutron] 10.222.0.44 "GET /v2.0/networks?id=9ab3f8b6-44d0-4210-907d-0e96072c4566 HTTP/1.1" status: 200 len: 917 time: 0.1259751 Dec 09 14:44:43.566582 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19a91a04-2b8b-400d-bd71-e2b6a0d6303d req-b43c6f7c-c48b-4426-81d9-d58fa1fac600 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:43.568604 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-29df3a0e-ea44-4cfb-b698-27735510d467 req-07a7fc28-2dba-46f3-9670-0d70fd116a6f service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 HTTP/1.1" status: 200 len: 1002 time: 0.0686402 Dec 09 14:44:43.569156 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-19a91a04-2b8b-400d-bd71-e2b6a0d6303d req-b43c6f7c-c48b-4426-81d9-d58fa1fac600 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 945 time: 0.0554392 Dec 09 14:44:43.620031 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-19a91a04-2b8b-400d-bd71-e2b6a0d6303d req-d751b55a-bca0-4fe9-a4db-b1b36b5ae16c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408499 Dec 09 14:44:43.621519 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29df3a0e-ea44-4cfb-b698-27735510d467 req-efd77775-fc09-4c80-a703-fccd8a8251b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:43.623009 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-29df3a0e-ea44-4cfb-b698-27735510d467 req-efd77775-fc09-4c80-a703-fccd8a8251b4 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=f10f1097-5d43-4737-bcac-a27ade66b442 HTTP/1.1" status: 200 len: 855 time: 0.0429626 Dec 09 14:44:43.675585 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29df3a0e-ea44-4cfb-b698-27735510d467 req-8a7e5f5f-a7ac-43d6-9821-a3cfa5538f95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:43.677098 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-29df3a0e-ea44-4cfb-b698-27735510d467 req-8a7e5f5f-a7ac-43d6-9821-a3cfa5538f95 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=9ab3f8b6-44d0-4210-907d-0e96072c4566&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0429490 Dec 09 14:44:43.776628 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-29df3a0e-ea44-4cfb-b698-27735510d467 req-475531ea-b102-4712-a556-4a5f3b34b189 service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874469 Dec 09 14:44:43.879676 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-29df3a0e-ea44-4cfb-b698-27735510d467 req-0b4cd5bd-4850-447c-b4fa-29066612edde service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872169 Dec 09 14:44:44.011238 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65cab805-3171-4a24-acb6-8d2c73b3bea7 req-28c91edb-9ec6-4dca-8eac-a7808e7bbe93 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:44.012811 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-65cab805-3171-4a24-acb6-8d2c73b3bea7 req-28c91edb-9ec6-4dca-8eac-a7808e7bbe93 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0531974 Dec 09 14:44:44.068353 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-65cab805-3171-4a24-acb6-8d2c73b3bea7 req-0ad6a3cb-a594-46eb-b3f9-3012a9da534f tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467837 Dec 09 14:44:44.350625 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ffe0d7b-f877-453b-b659-0cde8ee47b4a req-b1ddb37d-0cde-47c8-8305-5a1a7c0a234a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:44.352151 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5ffe0d7b-f877-453b-b659-0cde8ee47b4a req-b1ddb37d-0cde-47c8-8305-5a1a7c0a234a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 943 time: 0.0508273 Dec 09 14:44:44.406926 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5ffe0d7b-f877-453b-b659-0cde8ee47b4a req-1cc7f7a8-fb1f-4207-b5ca-49fcc111c7f7 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0481491 Dec 09 14:44:44.518093 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6181e415-ac95-4b22-b7dd-0553fe6f6c14 req-8a62d258-aee8-4d41-a379-b7f769de3faf tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:44.519632 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6181e415-ac95-4b22-b7dd-0553fe6f6c14 req-8a62d258-aee8-4d41-a379-b7f769de3faf tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0503976 Dec 09 14:44:44.582538 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6181e415-ac95-4b22-b7dd-0553fe6f6c14 req-8682ae2b-277f-4fa9-96b8-e35b4a2b9ef1 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0564270 Dec 09 14:44:44.739506 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:44.740209 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fe06a93-c16e-4a3b-96fb-84d40a4a7cd6 req-fc5774f4-281e-43d3-a86b-bdbc1ae792e7 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:44.741746 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2fe06a93-c16e-4a3b-96fb-84d40a4a7cd6 req-fc5774f4-281e-43d3-a86b-bdbc1ae792e7 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 945 time: 0.0530615 Dec 09 14:44:44.793679 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2fe06a93-c16e-4a3b-96fb-84d40a4a7cd6 req-e52a4d46-53a7-4e30-91a9-daf802b87be0 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452101 Dec 09 14:44:45.198633 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c8bc6f0-8eea-4250-a760-efb08e1b36c4 req-b15914d7-8f5e-4567-ad3c-3ac6debd2908 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:45.200215 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4c8bc6f0-8eea-4250-a760-efb08e1b36c4 req-b15914d7-8f5e-4567-ad3c-3ac6debd2908 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0500712 Dec 09 14:44:45.248634 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4c8bc6f0-8eea-4250-a760-efb08e1b36c4 req-76718024-062a-47d3-b7e2-907f72dc576b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423822 Dec 09 14:44:45.541150 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e1c60ae-0fc1-4205-b295-2ec7aa73dda8 req-5a77f6ac-613f-449f-8325-656d5cea8775 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:45.542653 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3e1c60ae-0fc1-4205-b295-2ec7aa73dda8 req-5a77f6ac-613f-449f-8325-656d5cea8775 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 943 time: 0.0592706 Dec 09 14:44:45.595437 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3e1c60ae-0fc1-4205-b295-2ec7aa73dda8 req-ff2226b8-bccf-4f74-ac32-62c6f5e1c956 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0467772 Dec 09 14:44:45.714771 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c59fece-6540-4a5d-a360-e7ebb6b243af req-a0f8c4bb-bbd6-42f5-b8f4-14a332b74e1a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:45.716305 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6c59fece-6540-4a5d-a360-e7ebb6b243af req-a0f8c4bb-bbd6-42f5-b8f4-14a332b74e1a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0593679 Dec 09 14:44:45.766885 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6c59fece-6540-4a5d-a360-e7ebb6b243af req-4f265aa3-28be-4202-ac52-9acfa7377427 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446374 Dec 09 14:44:45.918303 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a30355f-e7c5-48f8-8e3a-cf23626db2bf req-86ba4acb-3569-4603-a30e-3e664001f4fe tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:45.920014 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0a30355f-e7c5-48f8-8e3a-cf23626db2bf req-86ba4acb-3569-4603-a30e-3e664001f4fe tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 945 time: 0.0514314 Dec 09 14:44:45.967305 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0a30355f-e7c5-48f8-8e3a-cf23626db2bf req-53a56a6f-b5b7-4606-8c10-0a557ba66eca tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411608 Dec 09 14:44:46.204115 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b6ff8f4-d156-493d-ae36-bfe25ceb59e3 req-f8ee7db5-d1e5-49e5-bc0c-32cf8d7a0fe0 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:46.205682 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3b6ff8f4-d156-493d-ae36-bfe25ceb59e3 req-f8ee7db5-d1e5-49e5-bc0c-32cf8d7a0fe0 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 945 time: 0.0495594 Dec 09 14:44:46.331685 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-3b6ff8f4-d156-493d-ae36-bfe25ceb59e3 req-be094fa9-661f-48a7-8450-a6aafc349c73 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Deleting port 49a81388-ba4e-42e6-b643-dff0fadec9c5 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:44:46.332042 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-3b6ff8f4-d156-493d-ae36-bfe25ceb59e3 req-be094fa9-661f-48a7-8450-a6aafc349c73 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:46.449259 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa11041f-dd21-4608-b0a6-4599b133f63d req-e1d05885-7698-455e-81e7-f5e93438f034 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:46.450820 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-aa11041f-dd21-4608-b0a6-4599b133f63d req-e1d05885-7698-455e-81e7-f5e93438f034 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.1002951 Dec 09 14:44:46.467974 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-3b6ff8f4-d156-493d-ae36-bfe25ceb59e3 req-be094fa9-661f-48a7-8450-a6aafc349c73 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] For port 49a81388-ba4e-42e6-b643-dff0fadec9c5, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=49a81388-ba4e-42e6-b643-dff0fadec9c5,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:46.468344 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-3b6ff8f4-d156-493d-ae36-bfe25ceb59e3 req-be094fa9-661f-48a7-8450-a6aafc349c73 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:46.491913 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-3b6ff8f4-d156-493d-ae36-bfe25ceb59e3 req-be094fa9-661f-48a7-8450-a6aafc349c73 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Calling delete_port for 49a81388-ba4e-42e6-b643-dff0fadec9c5 owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:44:46.555777 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-aa11041f-dd21-4608-b0a6-4599b133f63d req-f708a2a5-e655-41e1-80a9-133459b6274c tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0971034 Dec 09 14:44:46.644352 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-3b6ff8f4-d156-493d-ae36-bfe25ceb59e3 req-be094fa9-661f-48a7-8450-a6aafc349c73 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:46.673462 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['746ea6aa-be43-4fbf-9463-02d741db305a', 'e559e9a2-7a62-4c44-83c1-bed1dc8d99e6', 'f52c3419-227a-4edd-add3-ffd3eea75b9d', '49a81388-ba4e-42e6-b643-dff0fadec9c5'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:44:46.676467 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be094fa9-661f-48a7-8450-a6aafc349c73 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Pushing event deleted for resources: {'Port': ['ID=49a81388-ba4e-42e6-b643-dff0fadec9c5,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:46.730088 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-3b6ff8f4-d156-493d-ae36-bfe25ceb59e3 req-be094fa9-661f-48a7-8450-a6aafc349c73 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] No DVR routers for this DVR port 49a81388-ba4e-42e6-b643-dff0fadec9c5 on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:44:46.733432 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-3b6ff8f4-d156-493d-ae36-bfe25ceb59e3 req-be094fa9-661f-48a7-8450-a6aafc349c73 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:46.737147 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3b6ff8f4-d156-493d-ae36-bfe25ceb59e3 req-be094fa9-661f-48a7-8450-a6aafc349c73 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "DELETE /v2.0/ports/49a81388-ba4e-42e6-b643-dff0fadec9c5 HTTP/1.1" status: 204 len: 173 time: 0.5151832 Dec 09 14:44:46.737632 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ec116497-9e3b-4fda-8c28-119755d4df1c', 'name': 'network-vif-deleted', 'tag': '49a81388-ba4e-42e6-b643-dff0fadec9c5'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:44:46.740145 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-145cbae8-485c-4d05-a40e-f791c0becc86" -d '{"events": [{"server_uuid": "ec116497-9e3b-4fda-8c28-119755d4df1c", "name": "network-vif-deleted", "tag": "49a81388-ba4e-42e6-b643-dff0fadec9c5"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:44:46.742746 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-659a572d-2950-4f76-9f30-9eb007190fc6 req-b6a650c3-f57f-4cba-b7c9-87308bc37664 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:46.744850 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-659a572d-2950-4f76-9f30-9eb007190fc6 req-b6a650c3-f57f-4cba-b7c9-87308bc37664 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 943 time: 0.0765648 Dec 09 14:44:46.783917 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:44:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8a25f49c-06dc-4510-8ab1-acd3caec1e46 x-openstack-request-id: req-8a25f49c-06dc-4510-8ab1-acd3caec1e46 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:44:46.784219 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ec116497-9e3b-4fda-8c28-119755d4df1c", "name": "network-vif-deleted", "tag": "49a81388-ba4e-42e6-b643-dff0fadec9c5", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:44:46.784485 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-8a25f49c-06dc-4510-8ab1-acd3caec1e46 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:44:46.785569 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ec116497-9e3b-4fda-8c28-119755d4df1c', 'name': 'network-vif-deleted', 'tag': '49a81388-ba4e-42e6-b643-dff0fadec9c5', 'status': 'completed', 'code': 200} Dec 09 14:44:46.808192 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-659a572d-2950-4f76-9f30-9eb007190fc6 req-86ac631f-c54d-4fd9-9334-d6e06b5b2adf tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0517106 Dec 09 14:44:46.895360 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95092f23-92ba-456e-ae52-be36d5134c37 req-c176e4e8-c35e-4af1-8bcc-a71c142ea382 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:46.896923 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-95092f23-92ba-456e-ae52-be36d5134c37 req-c176e4e8-c35e-4af1-8bcc-a71c142ea382 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0507014 Dec 09 14:44:46.946421 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-95092f23-92ba-456e-ae52-be36d5134c37 req-2c7eec16-aa3d-4b21-8a44-8adc75e901d4 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424025 Dec 09 14:44:47.071155 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c11d1ccf-ebc5-4478-afe5-fff836cbe660 req-a41293fe-6644-43df-b65c-4cb84f1af1fd tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec116497-9e3b-4fda-8c28-119755d4df1c HTTP/1.1" status: 200 len: 210 time: 0.0262914 Dec 09 14:44:47.677384 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e445f8fd-3a14-47c4-b386-a0d35d764206 req-8760705a-1841-4a9c-9fb1-311caf102891 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:47.678844 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e445f8fd-3a14-47c4-b386-a0d35d764206 req-8760705a-1841-4a9c-9fb1-311caf102891 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0492814 Dec 09 14:44:47.734131 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e445f8fd-3a14-47c4-b386-a0d35d764206 req-133130d1-89d4-44e3-8069-2529f42354e7 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465271 Dec 09 14:44:47.942377 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3795c234-d852-4209-9796-76260478c325 req-6b09ac28-65fd-4025-b692-49b422704873 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:47.943988 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3795c234-d852-4209-9796-76260478c325 req-6b09ac28-65fd-4025-b692-49b422704873 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 943 time: 0.0579753 Dec 09 14:44:47.994259 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3795c234-d852-4209-9796-76260478c325 req-3bef49d6-ed9c-4e85-922f-a034714df613 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436912 Dec 09 14:44:48.071884 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e845569-b06a-4a5f-b02b-be6a50793c0d req-c9e3cbff-916f-47d7-ad1c-b1b481de3b72 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:48.073511 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0e845569-b06a-4a5f-b02b-be6a50793c0d req-c9e3cbff-916f-47d7-ad1c-b1b481de3b72 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0526431 Dec 09 14:44:48.125158 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0e845569-b06a-4a5f-b02b-be6a50793c0d req-13f8c44a-f1ab-4d6a-a92e-a7d7fdf7a7af tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424793 Dec 09 14:44:48.967886 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device e44baa3b-39d9-4337-9599-d357f2381c7d details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:44:48.969945 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 49a81388-ba4e-42e6-b643-dff0fadec9c5 no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:44:48.995093 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: 49a81388-ba4e-42e6-b643-dff0fadec9c5 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:44:48.995463 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 49a81388-ba4e-42e6-b643-dff0fadec9c5 not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:44:49.083154 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port e44baa3b-39d9-4337-9599-d357f2381c7d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=e44baa3b-39d9-4337-9599-d357f2381c7d,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:49.092745 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02c719ce-c62a-49b1-8b69-28587064ec46 req-76b8e134-f44b-4a13-b8cb-5e70b842e5e4 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:49.094929 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-02c719ce-c62a-49b1-8b69-28587064ec46 req-76b8e134-f44b-4a13-b8cb-5e70b842e5e4 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0508201 Dec 09 14:44:49.095102 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': 'e44baa3b-39d9-4337-9599-d357f2381c7d', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'port_id': 'e44baa3b-39d9-4337-9599-d357f2381c7d', 'mac_address': 'fa:16:3e:16:eb:3e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 449, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:44:49.110043 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ccc1b18-13b5-47ea-83f5-4a45f2513d66 req-8f550d70-1e1b-40e9-8294-37f1a0261309 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:49.111818 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8ccc1b18-13b5-47ea-83f5-4a45f2513d66 req-8f550d70-1e1b-40e9-8294-37f1a0261309 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 943 time: 0.0502555 Dec 09 14:44:49.134300 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:49.142717 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-02c719ce-c62a-49b1-8b69-28587064ec46 req-8fdc9065-0e41-4313-bb6b-76b88b8f939d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416126 Dec 09 14:44:49.149114 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e44baa3b-39d9-4337-9599-d357f2381c7d {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:44:49.163591 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8ccc1b18-13b5-47ea-83f5-4a45f2513d66 req-c7496a4d-de8f-45a9-899b-a8a8d71abdeb tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450473 Dec 09 14:44:49.168352 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port e44baa3b-39d9-4337-9599-d357f2381c7d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=e44baa3b-39d9-4337-9599-d357f2381c7d,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:49.173419 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:49.225833 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=e44baa3b-39d9-4337-9599-d357f2381c7d,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:49.234322 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:49.234696 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:49.235040 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:49.235377 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:49.235742 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:49.236190 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:49.236524 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:49.236856 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:49.237176 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:49.237673 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:49.237818 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:49.238370 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:49.238625 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:49.267474 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b3b83da-9ddc-48ae-b737-b048a61cd45b req-e27e6bc0-6dd4-48b2-9850-e24133e4700d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:49.269043 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9b3b83da-9ddc-48ae-b737-b048a61cd45b req-e27e6bc0-6dd4-48b2-9850-e24133e4700d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0601945 Dec 09 14:44:49.320758 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9b3b83da-9ddc-48ae-b737-b048a61cd45b req-9e1bd2b3-1d28-4e1a-b93e-f8534c6b9f4f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457838 Dec 09 14:44:49.562944 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06f9166f-6b8b-4036-b932-a02b84fc8cd2 req-2b00c93e-8a05-4d84-8ef9-2d7b78a7d20e tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:49.564531 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-06f9166f-6b8b-4036-b932-a02b84fc8cd2 req-2b00c93e-8a05-4d84-8ef9-2d7b78a7d20e tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 946 time: 0.0523920 Dec 09 14:44:49.567245 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['e44baa3b-39d9-4337-9599-d357f2381c7d'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:44:49.616436 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-06f9166f-6b8b-4036-b932-a02b84fc8cd2 req-ab8dd626-8137-4490-989b-12cda0d14b82 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439816 Dec 09 14:44:50.294175 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b9bfe9-0642-4794-a3a0-5dfe5da06c75 req-ead6a9d3-31f4-4376-8867-5a61cb74da37 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:50.295726 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b9b9bfe9-0642-4794-a3a0-5dfe5da06c75 req-ead6a9d3-31f4-4376-8867-5a61cb74da37 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 944 time: 0.0590146 Dec 09 14:44:50.347682 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b9b9bfe9-0642-4794-a3a0-5dfe5da06c75 req-b692036c-4314-41b4-9200-5729f4771ffd tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447836 Dec 09 14:44:50.446148 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b7b66a0-dd0a-4774-8c6d-901643c59c53 req-c0d4ad8f-e27e-4514-b7fc-54ad6c8b7f2d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:50.447523 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-9b7b66a0-dd0a-4774-8c6d-901643c59c53 req-c0d4ad8f-e27e-4514-b7fc-54ad6c8b7f2d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0519862 Dec 09 14:44:50.499950 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-9b7b66a0-dd0a-4774-8c6d-901643c59c53 req-6dc4a5b8-2d83-4ca4-b783-e4f066f5f1cb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461421 Dec 09 14:44:50.734253 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4588566-8bcf-456d-904c-4e97716cf547 req-0929c8f5-c495-4fc6-9bfd-16e3c99c4cd5 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:50.735788 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c4588566-8bcf-456d-904c-4e97716cf547 req-0929c8f5-c495-4fc6-9bfd-16e3c99c4cd5 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 946 time: 0.0497344 Dec 09 14:44:50.786799 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c4588566-8bcf-456d-904c-4e97716cf547 req-b77cb5fe-15dc-4a5f-a306-74c76abdeacd tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444040 Dec 09 14:44:50.982418 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device e44baa3b-39d9-4337-9599-d357f2381c7d up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:44:51.039999 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port e44baa3b-39d9-4337-9599-d357f2381c7d completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:44:51.045012 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port e44baa3b-39d9-4337-9599-d357f2381c7d triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:51.045480 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:51.128736 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:51.158268 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e44baa3b-39d9-4337-9599-d357f2381c7d'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:44:51.160587 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ca878541-4151-4bf9-a891-c71706ee4d49" -d '{"events": [{"server_uuid": "fb81e6b3-1e55-4186-be5b-5f51f6563593", "name": "network-vif-plugged", "status": "completed", "tag": "e44baa3b-39d9-4337-9599-d357f2381c7d"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:44:51.173157 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port e44baa3b-39d9-4337-9599-d357f2381c7d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=e44baa3b-39d9-4337-9599-d357f2381c7d,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:51.177624 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:51.202942 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:44:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-dd1d5635-9471-4f20-bb49-b61f87e5a9a6 x-openstack-request-id: req-dd1d5635-9471-4f20-bb49-b61f87e5a9a6 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:44:51.203243 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fb81e6b3-1e55-4186-be5b-5f51f6563593", "name": "network-vif-plugged", "status": "completed", "tag": "e44baa3b-39d9-4337-9599-d357f2381c7d", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:44:51.203509 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-dd1d5635-9471-4f20-bb49-b61f87e5a9a6 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:44:51.203923 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e44baa3b-39d9-4337-9599-d357f2381c7d', 'code': 200} Dec 09 14:44:51.231457 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=e44baa3b-39d9-4337-9599-d357f2381c7d,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:51.471905 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b07bb620-d140-40d2-8bbc-df79bbedac4f req-c4b30b2f-97a5-403f-999e-08312324d87e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:51.473397 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b07bb620-d140-40d2-8bbc-df79bbedac4f req-c4b30b2f-97a5-403f-999e-08312324d87e service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 1098 time: 0.0679200 Dec 09 14:44:51.486276 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c99710f4-dc97-426e-8503-7e04d1ab74ae req-ce2ae7ba-67a0-4da1-9351-730f470419b3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:51.487647 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c99710f4-dc97-426e-8503-7e04d1ab74ae req-ce2ae7ba-67a0-4da1-9351-730f470419b3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0713115 Dec 09 14:44:51.554855 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b07bb620-d140-40d2-8bbc-df79bbedac4f req-e3bfa615-f612-4e10-94c3-f572f550b918 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0661952 Dec 09 14:44:51.563792 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c99710f4-dc97-426e-8503-7e04d1ab74ae req-2cd02990-aade-4e62-a82a-4e4c59b29748 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0701458 Dec 09 14:44:51.623975 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7030a584-548d-4e25-aeb3-fb5b44efe785 req-b2ff02e2-af62-4755-9e76-92accb0fdbd7 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:51.625442 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7030a584-548d-4e25-aeb3-fb5b44efe785 req-b2ff02e2-af62-4755-9e76-92accb0fdbd7 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0482163 Dec 09 14:44:51.678420 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7030a584-548d-4e25-aeb3-fb5b44efe785 req-7e897bd6-241b-41fb-b652-79dc9e5b9e54 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462706 Dec 09 14:44:51.847974 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7efef1db-18b5-4667-b896-e7fb9b614f1d req-44811ffb-ce99-4647-b720-a0b3129f58cb tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:51.849480 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7efef1db-18b5-4667-b896-e7fb9b614f1d req-44811ffb-ce99-4647-b720-a0b3129f58cb tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 946 time: 0.0722699 Dec 09 14:44:51.962603 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33f75845-0288-4ff1-a52f-8da9ce71f94a req-5c3b3d57-026c-4229-9c32-cde76e22dc40 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:51.964082 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33f75845-0288-4ff1-a52f-8da9ce71f94a req-5c3b3d57-026c-4229-9c32-cde76e22dc40 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=151740c8-abee-4794-ae76-20ebd9c216c8 HTTP/1.1" status: 200 len: 946 time: 0.0988855 Dec 09 14:44:52.014063 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-7efef1db-18b5-4667-b896-e7fb9b614f1d req-7c9e2b3e-62c2-4ef5-a3d9-0be93b07516c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Deleting port f52c3419-227a-4edd-add3-ffd3eea75b9d {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:44:52.014402 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-7efef1db-18b5-4667-b896-e7fb9b614f1d req-7c9e2b3e-62c2-4ef5-a3d9-0be93b07516c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:52.061932 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33f75845-0288-4ff1-a52f-8da9ce71f94a req-cb26f96e-fe6b-4587-8f24-dabdb7a8a6c3 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0907514 Dec 09 14:44:52.113278 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-7efef1db-18b5-4667-b896-e7fb9b614f1d req-7c9e2b3e-62c2-4ef5-a3d9-0be93b07516c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] For port f52c3419-227a-4edd-add3-ffd3eea75b9d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=f52c3419-227a-4edd-add3-ffd3eea75b9d,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:52.113682 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-7efef1db-18b5-4667-b896-e7fb9b614f1d req-7c9e2b3e-62c2-4ef5-a3d9-0be93b07516c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:52.127649 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-7efef1db-18b5-4667-b896-e7fb9b614f1d req-7c9e2b3e-62c2-4ef5-a3d9-0be93b07516c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Calling delete_port for f52c3419-227a-4edd-add3-ffd3eea75b9d owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:44:52.258492 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-7efef1db-18b5-4667-b896-e7fb9b614f1d req-7c9e2b3e-62c2-4ef5-a3d9-0be93b07516c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:52.273172 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['746ea6aa-be43-4fbf-9463-02d741db305a', 'e559e9a2-7a62-4c44-83c1-bed1dc8d99e6', 'f52c3419-227a-4edd-add3-ffd3eea75b9d'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:44:52.288415 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c9e2b3e-62c2-4ef5-a3d9-0be93b07516c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Pushing event deleted for resources: {'Port': ['ID=f52c3419-227a-4edd-add3-ffd3eea75b9d,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:52.331598 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-7efef1db-18b5-4667-b896-e7fb9b614f1d req-7c9e2b3e-62c2-4ef5-a3d9-0be93b07516c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] No DVR routers for this DVR port f52c3419-227a-4edd-add3-ffd3eea75b9d on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:44:52.334126 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-7efef1db-18b5-4667-b896-e7fb9b614f1d req-7c9e2b3e-62c2-4ef5-a3d9-0be93b07516c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:52.337504 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7efef1db-18b5-4667-b896-e7fb9b614f1d req-7c9e2b3e-62c2-4ef5-a3d9-0be93b07516c tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "DELETE /v2.0/ports/f52c3419-227a-4edd-add3-ffd3eea75b9d HTTP/1.1" status: 204 len: 173 time: 0.4786150 Dec 09 14:44:52.337953 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '151740c8-abee-4794-ae76-20ebd9c216c8', 'name': 'network-vif-deleted', 'tag': 'f52c3419-227a-4edd-add3-ffd3eea75b9d'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:44:52.340467 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-465b0a8b-3adc-40f7-bc05-9f1a80867a19" -d '{"events": [{"server_uuid": "151740c8-abee-4794-ae76-20ebd9c216c8", "name": "network-vif-deleted", "tag": "f52c3419-227a-4edd-add3-ffd3eea75b9d"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:44:52.379067 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:44:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b5da1042-41d7-4b25-ad2f-86c5fe799613 x-openstack-request-id: req-b5da1042-41d7-4b25-ad2f-86c5fe799613 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:44:52.379367 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "151740c8-abee-4794-ae76-20ebd9c216c8", "name": "network-vif-deleted", "tag": "f52c3419-227a-4edd-add3-ffd3eea75b9d", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:44:52.379658 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-b5da1042-41d7-4b25-ad2f-86c5fe799613 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:44:52.380066 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '151740c8-abee-4794-ae76-20ebd9c216c8', 'name': 'network-vif-deleted', 'tag': 'f52c3419-227a-4edd-add3-ffd3eea75b9d', 'status': 'completed', 'code': 200} Dec 09 14:44:52.697718 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03f0037e-51a4-4c13-a0f2-52a124b54307 req-df120f0b-0d01-428f-8450-10dadc1df17a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:52.699226 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-03f0037e-51a4-4c13-a0f2-52a124b54307 req-df120f0b-0d01-428f-8450-10dadc1df17a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0571091 Dec 09 14:44:52.756257 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-03f0037e-51a4-4c13-a0f2-52a124b54307 req-6600006c-890b-4f66-a700-ad1af7b559c5 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0508192 Dec 09 14:44:52.811620 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd76f02b-e167-48c7-851c-5b17d260a3e6 req-f22b9895-0d13-40ee-89b4-a3db7778d879 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:52.813117 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-dd76f02b-e167-48c7-851c-5b17d260a3e6 req-f22b9895-0d13-40ee-89b4-a3db7778d879 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0502918 Dec 09 14:44:52.872676 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-dd76f02b-e167-48c7-851c-5b17d260a3e6 req-c74d9d11-b548-4ecf-a395-a1bfb609cc1d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0528476 Dec 09 14:44:53.365171 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d13a771c-21b9-4695-bce0-ad9e14ea6e1e req-24b064c7-a627-4521-a9cb-45d312646e4f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:53.366663 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d13a771c-21b9-4695-bce0-ad9e14ea6e1e req-24b064c7-a627-4521-a9cb-45d312646e4f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 945 time: 0.0558028 Dec 09 14:44:53.414623 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d13a771c-21b9-4695-bce0-ad9e14ea6e1e req-11834cc2-c32c-4098-a383-f0b2296d3b6e tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409520 Dec 09 14:44:53.607783 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 56340) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:53.720288 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:53.798609 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:53.803345 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:53.871887 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=99061599fcc041fd887e596128039cd9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2628200 Dec 09 14:44:53.872614 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=390848cd-ec6d-4fc4-974b-808cf5bc152e,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:53.874641 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 56350) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:53.882685 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:53.883067 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:53.883409 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:53.883773 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:53.884104 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:53.884446 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:53.884790 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:53.885119 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:53.885443 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:53.885783 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:53.886386 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:53.886712 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:53.887030 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f7c7fde1-3828-49a3-9867-8132027a863c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:44:53.913612 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2f4165e-85c2-4912-af6d-62a52825f5fb req-1ae36556-262d-4148-a551-32ceab6354b3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:53.915198 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e2f4165e-85c2-4912-af6d-62a52825f5fb req-1ae36556-262d-4148-a551-32ceab6354b3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0920796 Dec 09 14:44:53.942473 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c3d0224b-220e-46cc-8474-7481cdae7082 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:53.972829 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c3d0224b-220e-46cc-8474-7481cdae7082 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:53.984098 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e2f4165e-85c2-4912-af6d-62a52825f5fb req-177a4139-969a-404a-8c30-0183451d6734 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0577805 Dec 09 14:44:54.090323 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fd0169c-0f73-4a8c-9148-e2d2cf5b1150 req-474bdf61-60ea-47f5-9734-c908e7f10b3f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:54.094722 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0fd0169c-0f73-4a8c-9148-e2d2cf5b1150 req-474bdf61-60ea-47f5-9734-c908e7f10b3f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0535617 Dec 09 14:44:54.148594 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0fd0169c-0f73-4a8c-9148-e2d2cf5b1150 req-add40673-0008-46eb-bba3-91e0e8e0a77a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469429 Dec 09 14:44:54.171149 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 56356) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:54.286410 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5527f67e-1c32-4928-b1a4-e1c0f32e5c5e req-8e608fe3-78d3-474c-ac3d-2ba53b07910c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:54.287978 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5527f67e-1c32-4928-b1a4-e1c0f32e5c5e req-8e608fe3-78d3-474c-ac3d-2ba53b07910c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.3005829 Dec 09 14:44:54.304583 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c3d0224b-220e-46cc-8474-7481cdae7082 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:54.307026 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c3d0224b-220e-46cc-8474-7481cdae7082 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:54.310839 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-c3d0224b-220e-46cc-8474-7481cdae7082 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/390848cd-ec6d-4fc4-974b-808cf5bc152e HTTP/1.1" status: 204 len: 168 time: 0.4319205 Dec 09 14:44:54.327885 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3d0224b-220e-46cc-8474-7481cdae7082 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=390848cd-ec6d-4fc4-974b-808cf5bc152e,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:54.361026 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-475167d5-ceac-4ca6-9945-62bd92c75a5c tempest-TestShelveInstance-1123153974 tempest-TestShelveInstance-1123153974-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:54.363652 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-475167d5-ceac-4ca6-9945-62bd92c75a5c tempest-TestShelveInstance-1123153974 tempest-TestShelveInstance-1123153974-project-admin] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 1093 time: 0.1904237 Dec 09 14:44:54.364372 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5527f67e-1c32-4928-b1a4-e1c0f32e5c5e req-69d12314-3661-4c74-b633-2df796db69a3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0674500 Dec 09 14:44:54.365718 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 56362) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:54.370804 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Request body: {'floatingip': {'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'port_id': 'e44baa3b-39d9-4337-9599-d357f2381c7d', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'fixed_ip_address': '172.20.0.6'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:54.396945 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for floatingip, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:54.505345 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:54.607704 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc6f9154-86f5-4b01-9a37-b0cc4071468f req-91d20aed-5b72-4196-a1ce-7c6921db3729 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:54.609247 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fc6f9154-86f5-4b01-9a37-b0cc4071468f req-91d20aed-5b72-4196-a1ce-7c6921db3729 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 945 time: 0.1017323 Dec 09 14:44:54.693234 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Allocated IP 172.27.0.128 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/5130d9f4-9a43-42a5-ab9c-4bd3f4d812f7) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:44:54.700689 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fc6f9154-86f5-4b01-9a37-b0cc4071468f req-d32e1337-1451-4a7a-a79e-a6f657ed9a35 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0834181 Dec 09 14:44:54.829238 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:54.865160 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:54.909382 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:44:54.912427 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:44:54.917022 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:44:54.920206 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Pushing event updated for resources: {'Port': ['ID=5130d9f4-9a43-42a5-ab9c-4bd3f4d812f7,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:54.984003 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:44:55.001256 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device f52c3419-227a-4edd-add3-ffd3eea75b9d no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:44:55.039658 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: f52c3419-227a-4edd-add3-ffd3eea75b9d {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:44:55.040265 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device f52c3419-227a-4edd-add3-ffd3eea75b9d not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:44:55.091492 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 56394) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:55.158348 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:55.175063 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'port_id': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'mac_address': 'fa:16:3e:50:6b:8c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 412, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:44:55.203879 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-2147048881-network', 'tenant_id': '3b3199edde77497bbdb703336ce72b78'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:55.226167 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.231802 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] Made reservation on behalf of 3b3199edde77497bbdb703336ce72b78 for: {'network': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:44:55.234766 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.241912 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:44:55.245348 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.245882 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc251cb8-0184-42c1-9f9c-2c8618429c69 req-81bfb918-9cd1-4975-ba96-7dc53253e361 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:55.248024 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-dc251cb8-0184-42c1-9f9c-2c8618429c69 req-81bfb918-9cd1-4975-ba96-7dc53253e361 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0858855 Dec 09 14:44:55.263357 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:55.268973 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.325566 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,revision_number=6']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:55.333491 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.339016 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.360366 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 421} {{(pid=109061) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:44:55.372270 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-dc251cb8-0184-42c1-9f9c-2c8618429c69 req-8e924f6a-17d8-4c8f-b7a0-9d560c781346 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1042385 Dec 09 14:44:55.379011 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c07b8fd5-6306-4357-a7fe-deb9f81df7ba,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:55.382047 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.382387 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.segments_db [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] Added segment e2f74911-9ec7-4d46-b689-ab5ae0cbb567 of type vlan for network 8ae9a24a-645d-43a9-b32c-41629b26c09e Dec 09 14:44:55.406920 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:44:55.464410 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.468606 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.534109 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c00e7d45-47c2-4fcd-9a7c-7dd103722ace req-62d8cc2b-71b1-4726-8e00-ddc7c05132d9 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:55.535979 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c00e7d45-47c2-4fcd-9a7c-7dd103722ace req-62d8cc2b-71b1-4726-8e00-ddc7c05132d9 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 945 time: 0.1108506 Dec 09 14:44:55.542427 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.554416 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.555634 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:55.556490 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.589332 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30601a6c-0b26-46bc-91ec-7854a68f2828 req-2c3c7aeb-87a0-484d-8378-198237a484fb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:55.596818 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-30601a6c-0b26-46bc-91ec-7854a68f2828 req-2c3c7aeb-87a0-484d-8378-198237a484fb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 945 time: 0.1294544 Dec 09 14:44:55.672685 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.5801628 Dec 09 14:44:55.675500 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 56400) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:44:55.680292 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-634b01d5-ed3d-41e9-b748-4e33a0db82b7 admin admin] Request body: {'subnet': {'network_id': '8ae9a24a-645d-43a9-b32c-41629b26c09e', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-2147048881-subnet', 'tenant_id': '3b3199edde77497bbdb703336ce72b78', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:44:55.710317 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.719455 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-130461426'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.733999 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99f219e9-dc41-4ae4-be68-67e07bdb4eb3 admin admin] Pushing event updated for resources: {'Network': ['ID=8ae9a24a-645d-43a9-b32c-41629b26c09e,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:55.746914 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network 8ae9a24a-645d-43a9-b32c-41629b26c09e details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:44:55.750926 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-634b01d5-ed3d-41e9-b748-4e33a0db82b7 admin admin] Made reservation on behalf of 3b3199edde77497bbdb703336ce72b78 for: {'subnet': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:44:55.753322 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-634b01d5-ed3d-41e9-b748-4e33a0db82b7 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-130588657'] for subnet, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.759806 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-30601a6c-0b26-46bc-91ec-7854a68f2828 req-45862b81-c67e-41a4-86e4-b512ac73b226 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1613693 Dec 09 14:44:55.788927 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-c00e7d45-47c2-4fcd-9a7c-7dd103722ace req-1c18c0d4-4d88-48f3-a6b1-85073dd87ec8 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Deleting port e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:44:55.789490 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-c00e7d45-47c2-4fcd-9a7c-7dd103722ace req-1c18c0d4-4d88-48f3-a6b1-85073dd87ec8 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.853463 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.886282 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-c00e7d45-47c2-4fcd-9a7c-7dd103722ace req-1c18c0d4-4d88-48f3-a6b1-85073dd87ec8 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] For port e559e9a2-7a62-4c44-83c1-bed1dc8d99e6, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=e559e9a2-7a62-4c44-83c1-bed1dc8d99e6,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:55.886738 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-c00e7d45-47c2-4fcd-9a7c-7dd103722ace req-1c18c0d4-4d88-48f3-a6b1-85073dd87ec8 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:55.899413 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-c00e7d45-47c2-4fcd-9a7c-7dd103722ace req-1c18c0d4-4d88-48f3-a6b1-85073dd87ec8 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Calling delete_port for e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:44:55.927868 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Pushing event updated for resources: {'Port': ['ID=5130d9f4-9a43-42a5-ab9c-4bd3f4d812f7,revision_number=2']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:56.014357 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cc591eb-0439-4468-9ccb-98edb68115ab req-8d900e85-b5d3-4886-8194-0a4f3fe12b9a tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:56.015836 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-9cc591eb-0439-4468-9ccb-98edb68115ab req-8d900e85-b5d3-4886-8194-0a4f3fe12b9a tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=84fcfcdd-cc22-49d3-aa97-428cb9a1c56a HTTP/1.1" status: 200 len: 945 time: 0.1635473 Dec 09 14:44:56.031065 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-c00e7d45-47c2-4fcd-9a7c-7dd103722ace req-1c18c0d4-4d88-48f3-a6b1-85073dd87ec8 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:56.051363 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['746ea6aa-be43-4fbf-9463-02d741db305a', 'e559e9a2-7a62-4c44-83c1-bed1dc8d99e6'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:44:56.059703 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c18c0d4-4d88-48f3-a6b1-85073dd87ec8 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Pushing event deleted for resources: {'Port': ['ID=e559e9a2-7a62-4c44-83c1-bed1dc8d99e6,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:56.083286 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.l3_db [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Floating IP eb1ffbd2-71c3-4e95-8adb-88c59352e84d associated. External IP: 172.27.0.128, port: e44baa3b-39d9-4337-9599-d357f2381c7d. Dec 09 14:44:56.101592 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-c00e7d45-47c2-4fcd-9a7c-7dd103722ace req-1c18c0d4-4d88-48f3-a6b1-85073dd87ec8 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] No DVR routers for this DVR port e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:44:56.104057 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-c00e7d45-47c2-4fcd-9a7c-7dd103722ace req-1c18c0d4-4d88-48f3-a6b1-85073dd87ec8 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:56.107707 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c00e7d45-47c2-4fcd-9a7c-7dd103722ace req-1c18c0d4-4d88-48f3-a6b1-85073dd87ec8 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "DELETE /v2.0/ports/e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 HTTP/1.1" status: 204 len: 173 time: 0.5640128 Dec 09 14:44:56.108343 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '84fcfcdd-cc22-49d3-aa97-428cb9a1c56a', 'name': 'network-vif-deleted', 'tag': 'e559e9a2-7a62-4c44-83c1-bed1dc8d99e6'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:44:56.110616 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-931fe0d1-b452-41b8-b3b9-a48bbb3e94cc" -d '{"events": [{"server_uuid": "84fcfcdd-cc22-49d3-aa97-428cb9a1c56a", "name": "network-vif-deleted", "tag": "e559e9a2-7a62-4c44-83c1-bed1dc8d99e6"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:44:56.149501 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:44:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d68fd2c0-4821-46f7-bdf9-f4242d3128aa x-openstack-request-id: req-d68fd2c0-4821-46f7-bdf9-f4242d3128aa {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:44:56.151010 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "84fcfcdd-cc22-49d3-aa97-428cb9a1c56a", "name": "network-vif-deleted", "tag": "e559e9a2-7a62-4c44-83c1-bed1dc8d99e6", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:44:56.151389 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-d68fd2c0-4821-46f7-bdf9-f4242d3128aa {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:44:56.152799 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '84fcfcdd-cc22-49d3-aa97-428cb9a1c56a', 'name': 'network-vif-deleted', 'tag': 'e559e9a2-7a62-4c44-83c1-bed1dc8d99e6', 'status': 'completed', 'code': 200} Dec 09 14:44:56.205731 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-9cc591eb-0439-4468-9ccb-98edb68115ab req-ad74fe3d-15a7-405d-93c6-87c918752b2e tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1775761 Dec 09 14:44:56.273777 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-634b01d5-ed3d-41e9-b748-4e33a0db82b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-130461295', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-130768923'] for subnet, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:56.515691 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13dec256-41ed-49e1-8b1c-e5255a44eb61 req-c2b89bbb-e8cb-4db8-9953-9811c7c38334 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:56.517272 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-13dec256-41ed-49e1-8b1c-e5255a44eb61 req-c2b89bbb-e8cb-4db8-9953-9811c7c38334 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0582530 Dec 09 14:44:56.568864 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-13dec256-41ed-49e1-8b1c-e5255a44eb61 req-cf9bf913-092c-43ff-bf52-8b236cfe856d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452137 Dec 09 14:44:56.605533 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-634b01d5-ed3d-41e9-b748-4e33a0db82b7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a44bb60f-825d-4a27-a5af-fbe9e6e78fb7,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:56.616480 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-634b01d5-ed3d-41e9-b748-4e33a0db82b7 admin admin] Checking segment: {'id': 'e2f74911-9ec7-4d46-b689-ab5ae0cbb567', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 421, 'network_id': '8ae9a24a-645d-43a9-b32c-41629b26c09e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109062) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:44:56.616840 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-634b01d5-ed3d-41e9-b748-4e33a0db82b7 admin admin] Network hostable DHCP agents. Network: 8ae9a24a-645d-43a9-b32c-41629b26c09e, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109062) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:44:56.675929 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-634b01d5-ed3d-41e9-b748-4e33a0db82b7 admin admin] Network 8ae9a24a-645d-43a9-b32c-41629b26c09e is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109062) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:44:56.690451 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:44:56.691965 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-634b01d5-ed3d-41e9-b748-4e33a0db82b7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, 8ae9a24a-645d-43a9-b32c-41629b26c09e) {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:44:56.697850 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-634b01d5-ed3d-41e9-b748-4e33a0db82b7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:56.698458 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-634b01d5-ed3d-41e9-b748-4e33a0db82b7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:56.701008 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-aba862b7-9043-49d4-91d2-9d9f942538cb None None] Network 8ae9a24a-645d-43a9-b32c-41629b26c09e requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:44:56.759060 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-634b01d5-ed3d-41e9-b748-4e33a0db82b7 admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.0734742 Dec 09 14:44:56.832306 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:44:56.847802 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-278aa9e4-997d-437c-868f-d84a8895b050 None None] Sync routers for ids ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:44:56.864570 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6bdf91e8-cbdc-4f21-a929-a38488319cec None None] Network 8ae9a24a-645d-43a9-b32c-41629b26c09e requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:44:56.874351 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-278aa9e4-997d-437c-868f-d84a8895b050 None None] Routers {'ff4d224c-d767-4521-9fd6-3bfbaaddfe44'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:44:56.876677 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-278aa9e4-997d-437c-868f-d84a8895b050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:44:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:44:56.932487 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:57.003598 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:44:57.024300 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2012acab-69b8-4aef-b545-d93453297fee req-15fbb959-5dd0-4a43-9a1c-70f8499dc5ed tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:57.029476 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2012acab-69b8-4aef-b545-d93453297fee req-15fbb959-5dd0-4a43-9a1c-70f8499dc5ed tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 945 time: 0.1942995 Dec 09 14:44:57.044935 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-80cecad1-ac68-4405-9ad4-a08a6a9e9985 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:57.050491 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-2bbba596-2704-4df9-8bc4-1b0339e4c89f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.6835885 Dec 09 14:44:57.063555 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'tag': 'e44baa3b-39d9-4337-9599-d357f2381c7d'}] {{(pid=109062) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:44:57.079646 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3f1ec408b0eec5a36b56e0a757eff0f4875d9a95eff62f4d0b4a62bb27a3b600" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-50ebc517-8e71-47ae-b96c-644f67e5cbee" -d '{"events": [{"name": "network-changed", "server_uuid": "fb81e6b3-1e55-4186-be5b-5f51f6563593", "tag": "e44baa3b-39d9-4337-9599-d357f2381c7d"}]}' {{(pid=109062) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:44:57.108742 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:44:57.109292 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:57.123114 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-278aa9e4-997d-437c-868f-d84a8895b050 None None] Set router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:44:57.164714 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:44:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f43988a2-6623-4431-adb1-d4780ced449a x-openstack-request-id: req-f43988a2-6623-4431-adb1-d4780ced449a {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:44:57.165047 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fb81e6b3-1e55-4186-be5b-5f51f6563593", "tag": "e44baa3b-39d9-4337-9599-d357f2381c7d", "status": "completed", "code": 200}]} {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:44:57.165275 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-f43988a2-6623-4431-adb1-d4780ced449a {{(pid=109062) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:44:57.165655 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'tag': 'e44baa3b-39d9-4337-9599-d357f2381c7d', 'status': 'completed', 'code': 200} Dec 09 14:44:57.170891 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2012acab-69b8-4aef-b545-d93453297fee req-677e4891-e265-4769-b79c-7284e58a7c66 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1184714 Dec 09 14:44:57.226964 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ebc517-8e71-47ae-b96c-644f67e5cbee req-5e0a0126-61bd-445c-a323-9f7f4d26a3dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:57.228789 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-50ebc517-8e71-47ae-b96c-644f67e5cbee req-5e0a0126-61bd-445c-a323-9f7f4d26a3dc service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=10d73d0acf44499e88f6d53847b2094e&device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 1098 time: 0.0510299 Dec 09 14:44:57.265541 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:57.319440 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:44:57.323773 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bbd43adb-8857-4ca0-9d9b-aaffef295b91" -d '{"events": [{"server_uuid": "a8ee2ec0-d1d7-458d-ae2a-509098efff13", "name": "network-vif-plugged", "status": "completed", "tag": "eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:44:57.338535 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:44:57.345905 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:57.347463 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:44:57.360493 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ebc517-8e71-47ae-b96c-644f67e5cbee req-4b37c561-32c0-466f-893b-19111f0165b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:57.363131 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-50ebc517-8e71-47ae-b96c-644f67e5cbee req-4b37c561-32c0-466f-893b-19111f0165b5 service neutron] 10.222.0.44 "GET /v2.0/networks?id=f0982548-601b-4206-88dc-a16a0317b421 HTTP/1.1" status: 200 len: 909 time: 0.1252062 Dec 09 14:44:57.377412 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:44:57.377882 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device e559e9a2-7a62-4c44-83c1-bed1dc8d99e6 not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:44:57.429844 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:44:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-623587fb-8a0a-413f-a5c7-5570c57cc2da x-openstack-request-id: req-623587fb-8a0a-413f-a5c7-5570c57cc2da {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:44:57.430151 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a8ee2ec0-d1d7-458d-ae2a-509098efff13", "name": "network-vif-plugged", "status": "completed", "tag": "eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:44:57.430384 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-623587fb-8a0a-413f-a5c7-5570c57cc2da {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:44:57.430827 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'code': 200} Dec 09 14:44:57.438154 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,revision_number=7']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:44:57.451410 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-50ebc517-8e71-47ae-b96c-644f67e5cbee req-a9bc58b7-ef37-401d-b8e8-187fcd1ee4a3 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e44baa3b-39d9-4337-9599-d357f2381c7d HTTP/1.1" status: 200 len: 999 time: 0.0800788 Dec 09 14:44:57.510739 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ebc517-8e71-47ae-b96c-644f67e5cbee req-c7cc2076-4915-4be8-a7f5-bafe4c7b25ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:57.512273 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-50ebc517-8e71-47ae-b96c-644f67e5cbee req-c7cc2076-4915-4be8-a7f5-bafe4c7b25ca service neutron] 10.222.0.44 "GET /v2.0/subnets?id=7edf1e5e-d953-4e3c-8dc5-29475e258db2 HTTP/1.1" status: 200 len: 847 time: 0.0532892 Dec 09 14:44:57.571334 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-278aa9e4-997d-437c-868f-d84a8895b050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:50Z', 'updated_at': '2021-12-09T14:43:56Z', 'revision_number': 4, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'gw_port': {'id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:38:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:51Z', 'updated_at': '2021-12-09T14:43:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': 'eb1ffbd2-71c3-4e95-8adb-88c59352e84d', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'floating_ip_address': '172.27.0.128', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'port_id': 'e44baa3b-39d9-4337-9599-d357f2381c7d', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 388, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'mac_address': 'fa:16:3e:16:eb:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:44:55Z', 'updated_at': '2021-12-09T14:44:55Z', 'revision_number': 0, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c3bcca35-88a0-437e-a9e8-3bcbcd962647', 'name': '', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'mac_address': 'fa:16:3e:97:bd:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_interface', 'standard_attr_id': 277, 'fixed_ips': [{'subnet_id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:55Z', 'updated_at': '2021-12-09T14:44:02Z', 'revision_number': 5, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'subnets': [{'id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:44:57.600721 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50ebc517-8e71-47ae-b96c-644f67e5cbee req-b3e2368f-54c8-4add-98ce-c2dbe79a0cfc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:57.602398 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-50ebc517-8e71-47ae-b96c-644f67e5cbee req-b3e2368f-54c8-4add-98ce-c2dbe79a0cfc service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=f0982548-601b-4206-88dc-a16a0317b421&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0772026 Dec 09 14:44:57.630671 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-278aa9e4-997d-437c-868f-d84a8895b050 None None] Checking router: ff4d224c-d767-4521-9fd6-3bfbaaddfe44 for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:44:57.643490 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-278aa9e4-997d-437c-868f-d84a8895b050 None None] Routers {'ff4d224c-d767-4521-9fd6-3bfbaaddfe44'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:44:57.644716 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-278aa9e4-997d-437c-868f-d84a8895b050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:44:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:44:57.784790 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-278aa9e4-997d-437c-868f-d84a8895b050 None None] Set router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:44:57.801961 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b71ffeb-2d74-4db4-9fcb-fb0137fb09f9 req-32347531-73c6-40e0-ab9e-d80b9766e38e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:57.803513 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b71ffeb-2d74-4db4-9fcb-fb0137fb09f9 req-32347531-73c6-40e0-ab9e-d80b9766e38e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0920823 Dec 09 14:44:57.805916 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-50ebc517-8e71-47ae-b96c-644f67e5cbee req-d6e66060-c1cb-42cd-9f17-eda69a2f1d3d service neutron] 10.222.0.44 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1942337 Dec 09 14:44:57.927092 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b71ffeb-2d74-4db4-9fcb-fb0137fb09f9 req-d97c6b6e-6e62-4f26-b8e8-e0ad726e37b6 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1135836 Dec 09 14:44:57.958686 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-50ebc517-8e71-47ae-b96c-644f67e5cbee req-3452fb3f-2109-45eb-a103-b4249e6c7274 service neutron] 10.222.0.44 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1369689 Dec 09 14:44:58.067940 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-278aa9e4-997d-437c-868f-d84a8895b050 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:50Z', 'updated_at': '2021-12-09T14:43:56Z', 'revision_number': 4, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'gw_port': {'id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:38:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:51Z', 'updated_at': '2021-12-09T14:43:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': 'eb1ffbd2-71c3-4e95-8adb-88c59352e84d', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'floating_ip_address': '172.27.0.128', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'port_id': 'e44baa3b-39d9-4337-9599-d357f2381c7d', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 388, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'mac_address': 'fa:16:3e:16:eb:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:44:55Z', 'updated_at': '2021-12-09T14:44:55Z', 'revision_number': 0, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c3bcca35-88a0-437e-a9e8-3bcbcd962647', 'name': '', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'mac_address': 'fa:16:3e:97:bd:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_interface', 'standard_attr_id': 277, 'fixed_ips': [{'subnet_id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:55Z', 'updated_at': '2021-12-09T14:44:02Z', 'revision_number': 5, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'subnets': [{'id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:44:58.095989 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-278aa9e4-997d-437c-868f-d84a8895b050 None None] The sync data for ids ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'] in dv-cinder-819692-8-iscsi is: [{'id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:50Z', 'updated_at': '2021-12-09T14:43:56Z', 'revision_number': 4, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'gw_port': {'id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:38:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:51Z', 'updated_at': '2021-12-09T14:43:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': 'eb1ffbd2-71c3-4e95-8adb-88c59352e84d', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'floating_ip_address': '172.27.0.128', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'port_id': 'e44baa3b-39d9-4337-9599-d357f2381c7d', 'fixed_ip_address': '172.20.0.6', 'status': 'DOWN', 'standard_attr_id': 388, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'mac_address': 'fa:16:3e:16:eb:3e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:44:55Z', 'updated_at': '2021-12-09T14:44:55Z', 'revision_number': 0, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'c3bcca35-88a0-437e-a9e8-3bcbcd962647', 'name': '', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'mac_address': 'fa:16:3e:97:bd:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_interface', 'standard_attr_id': 277, 'fixed_ips': [{'subnet_id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:55Z', 'updated_at': '2021-12-09T14:44:02Z', 'revision_number': 5, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'subnets': [{'id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:44:58.323147 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-900d10e9-9370-4ef9-86ef-0c6ee560327d req-892162af-fa67-4cd1-bdf8-2519a3e65151 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:58.324704 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-900d10e9-9370-4ef9-86ef-0c6ee560327d req-892162af-fa67-4cd1-bdf8-2519a3e65151 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0664485 Dec 09 14:44:58.339416 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce69d696-edb0-4564-8244-c5812c3309cd None None] New status for floating IP eb1ffbd2-71c3-4e95-8adb-88c59352e84d: ACTIVE {{(pid=109063) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:44:58.397770 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-900d10e9-9370-4ef9-86ef-0c6ee560327d req-e1eae50d-b7d9-4a1a-b4d5-c3c357c89d02 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0651510 Dec 09 14:44:58.888265 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2844fe04-7e56-416d-9bb9-be6c03136d48 req-f988e7b9-e360-4f8d-86ac-940d25cb2932 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:58.890383 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2844fe04-7e56-416d-9bb9-be6c03136d48 req-f988e7b9-e360-4f8d-86ac-940d25cb2932 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 945 time: 0.0665579 Dec 09 14:44:58.948104 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-e61dff0d-7931-4218-b483-1a446161b7db tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:58.956916 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-e61dff0d-7931-4218-b483-1a446161b7db tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/networks?id=8ae9a24a-645d-43a9-b32c-41629b26c09e HTTP/1.1" status: 200 len: 814 time: 0.1816685 Dec 09 14:44:58.995101 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-f19124da-eb3d-4163-870e-e90d868ed94a tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/quotas/3b3199edde77497bbdb703336ce72b78 HTTP/1.1" status: 200 len: 375 time: 0.0369067 Dec 09 14:44:59.018457 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2844fe04-7e56-416d-9bb9-be6c03136d48 req-a9bf4f85-4d69-4300-ba40-f43c7c4df6fa tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1213632 Dec 09 14:44:59.074218 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-9c068c22-1025-4758-a76f-aa3e91aea835 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=3b3199edde77497bbdb703336ce72b78&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0777900 Dec 09 14:44:59.181323 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65be410c-8564-4fe1-8593-3b202a5f368b req-8234111d-d02a-41e0-8565-d3449382b27b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:59.182930 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-65be410c-8564-4fe1-8593-3b202a5f368b req-8234111d-d02a-41e0-8565-d3449382b27b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0573194 Dec 09 14:44:59.194675 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-371d4b7c-625a-4bff-8b1f-e295a5cc84ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:44:59.219220 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-9983ecf0-5a31-46bb-bca7-4f394fadc9ef service neutron] 10.222.0.39 "GET /v2.0/networks/8ae9a24a-645d-43a9-b32c-41629b26c09e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1330574 Dec 09 14:44:59.252322 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-65be410c-8564-4fe1-8593-3b202a5f368b req-8e221730-65aa-4471-9920-dc99e74bb0d7 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0600376 Dec 09 14:44:59.325709 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-a3aea528-02b1-405f-93ef-38ad6879d544 service neutron] 10.222.0.39 "GET /v2.0/networks/8ae9a24a-645d-43a9-b32c-41629b26c09e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1053648 Dec 09 14:44:59.559860 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8099fed7-4ec8-4964-8498-97046329d962 req-d88b4937-5d8b-4df9-8f38-56621195d354 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:44:59.561587 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1ac59969-3cc1-4ebe-87c6-685f1321e401 req-78858d9a-f3ea-4e67-bc41-c3de4269ae82 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 210 time: 0.0515833 Dec 09 14:44:59.567740 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8099fed7-4ec8-4964-8498-97046329d962 req-d88b4937-5d8b-4df9-8f38-56621195d354 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0753052 Dec 09 14:44:59.642540 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8099fed7-4ec8-4964-8498-97046329d962 req-f8bf6cd2-73d0-41c6-bd18-5b04fa6c2c3b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0729873 Dec 09 14:45:00.184126 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b7e19ff-b179-4dea-80c4-f30a48c9e2ae req-bd34156d-10e0-4b5c-9c14-51385e288bee tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:00.193013 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4b7e19ff-b179-4dea-80c4-f30a48c9e2ae req-bd34156d-10e0-4b5c-9c14-51385e288bee tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 945 time: 0.0899327 Dec 09 14:45:00.248104 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4b7e19ff-b179-4dea-80c4-f30a48c9e2ae req-694609b6-1ac0-48b0-8f89-7006102549f1 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0522752 Dec 09 14:45:00.391444 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1229e307-8a15-490c-86a8-426552b75114 req-9c79c8c9-1505-4d53-8a1c-0792663bb109 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:00.392964 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1229e307-8a15-490c-86a8-426552b75114 req-9c79c8c9-1505-4d53-8a1c-0792663bb109 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0592246 Dec 09 14:45:00.420569 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:00.454958 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1229e307-8a15-490c-86a8-426552b75114 req-87327134-c118-4c8b-bbb4-3024d5061bb1 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0496652 Dec 09 14:45:00.664268 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1c0287a2-9416-40ac-ae5c-bdcba19f3107 req-15ecd575-ff83-431f-9e78-eaa870a70323 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 210 time: 0.0284324 Dec 09 14:45:00.803158 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e83798e-0804-4b7e-8ba3-8e5185a961be req-687fac4e-186d-4ba3-b25e-0cd7a84b9b88 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:00.810807 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9e83798e-0804-4b7e-8ba3-8e5185a961be req-687fac4e-186d-4ba3-b25e-0cd7a84b9b88 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0832622 Dec 09 14:45:00.874912 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9e83798e-0804-4b7e-8ba3-8e5185a961be req-598b175e-e21b-43f9-ad54-6dd48cc3c54b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0630963 Dec 09 14:45:01.011333 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-f3b9582c-37a6-490b-86a5-d773bbd0a975 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:01.013029 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-f3b9582c-37a6-490b-86a5-d773bbd0a975 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.44 "GET /v2.0/networks?id=8ae9a24a-645d-43a9-b32c-41629b26c09e HTTP/1.1" status: 200 len: 814 time: 0.1557817 Dec 09 14:45:01.028247 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-b07857c3-56ac-413b-8339-caed4616c135 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Request body: {'port': {'device_id': 'd798c281-d19b-4602-8aea-7542278bcd34', 'network_id': '8ae9a24a-645d-43a9-b32c-41629b26c09e', 'admin_state_up': True, 'tenant_id': '3b3199edde77497bbdb703336ce72b78'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:45:01.204307 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-b07857c3-56ac-413b-8339-caed4616c135 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Made reservation on behalf of 3b3199edde77497bbdb703336ce72b78 for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:45:01.209626 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-b07857c3-56ac-413b-8339-caed4616c135 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:01.314931 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e1fda51-ec0c-46aa-977c-39ff24d9084f req-0d937b30-d544-492e-99dd-4dfa50ea7763 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:01.316729 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4e1fda51-ec0c-46aa-977c-39ff24d9084f req-0d937b30-d544-492e-99dd-4dfa50ea7763 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 945 time: 0.1274390 Dec 09 14:45:01.397810 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7cd307a-3dbe-4fab-b700-07bccd6c8c10 req-1f0729e5-22f0-4ee9-a005-8f3622ce3e3d tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:01.418432 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f7cd307a-3dbe-4fab-b700-07bccd6c8c10 req-1f0729e5-22f0-4ee9-a005-8f3622ce3e3d tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 945 time: 0.0917587 Dec 09 14:45:01.459636 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-b07857c3-56ac-413b-8339-caed4616c135 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Allocated IP 172.20.0.8 (8ae9a24a-645d-43a9-b32c-41629b26c09e/a44bb60f-825d-4a27-a5af-fbe9e6e78fb7/15210d7b-a185-432f-9885-014d180eb6b9) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:45:01.568672 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f7cd307a-3dbe-4fab-b700-07bccd6c8c10 req-12cca8ba-2cf9-47ca-ab40-6bfc02e33f14 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/security-groups?id=8fcac96f-cc33-4e38-a206-df35f6e6373e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1473031 Dec 09 14:45:01.585131 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-4e1fda51-ec0c-46aa-977c-39ff24d9084f req-f57d6812-2b65-4031-b476-326de644589f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Deleting port 746ea6aa-be43-4fbf-9463-02d741db305a {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:45:01.585579 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4e1fda51-ec0c-46aa-977c-39ff24d9084f req-f57d6812-2b65-4031-b476-326de644589f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:01.797474 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4244aca3-7383-45db-b4b6-212643136d3c req-d38909f4-b0c2-48ac-920f-9e9a22b25d49 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 210 time: 0.0457640 Dec 09 14:45:01.799410 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:01.821139 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-b07857c3-56ac-413b-8339-caed4616c135 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:01.853387 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eca56de6-1ae7-46cd-8d55-084992710367 req-e712f60c-025a-45f8-87f0-a1660460ce1b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:01.855016 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-eca56de6-1ae7-46cd-8d55-084992710367 req-e712f60c-025a-45f8-87f0-a1660460ce1b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.2445321 Dec 09 14:45:01.879387 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-4e1fda51-ec0c-46aa-977c-39ff24d9084f req-f57d6812-2b65-4031-b476-326de644589f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] For port 746ea6aa-be43-4fbf-9463-02d741db305a, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=746ea6aa-be43-4fbf-9463-02d741db305a,segment=NetworkSegment(f11d9e19-2d99-4f20-a186-cdaeddb729de),segment_id=f11d9e19-2d99-4f20-a186-cdaeddb729de)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:45:01.880198 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4e1fda51-ec0c-46aa-977c-39ff24d9084f req-f57d6812-2b65-4031-b476-326de644589f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:01.918106 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-4e1fda51-ec0c-46aa-977c-39ff24d9084f req-f57d6812-2b65-4031-b476-326de644589f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Calling delete_port for 746ea6aa-be43-4fbf-9463-02d741db305a owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:45:01.992653 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-b07857c3-56ac-413b-8339-caed4616c135 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:02.023331 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-512e9646-aeef-4103-ae3a-934e85e7f89d req-da99542e-c3fa-4a74-90e7-8f89580d243e tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:02.025259 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-512e9646-aeef-4103-ae3a-934e85e7f89d req-da99542e-c3fa-4a74-90e7-8f89580d243e tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0629995 Dec 09 14:45:02.041296 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-eca56de6-1ae7-46cd-8d55-084992710367 req-a1b7d876-99df-4546-b31d-1d4c45388768 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1786916 Dec 09 14:45:02.071957 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-b07857c3-56ac-413b-8339-caed4616c135 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Network 8ae9a24a-645d-43a9-b32c-41629b26c09e is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:45:02.088168 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-512e9646-aeef-4103-ae3a-934e85e7f89d req-64caa059-1d5a-4fb3-a500-3fafdc7cf62f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0555317 Dec 09 14:45:02.089734 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-b07857c3-56ac-413b-8339-caed4616c135 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:45:02.100762 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-b07857c3-56ac-413b-8339-caed4616c135 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:45:02.103576 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b07857c3-56ac-413b-8339-caed4616c135 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Pushing event updated for resources: {'Port': ['ID=15210d7b-a185-432f-9885-014d180eb6b9,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:02.203465 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-b07857c3-56ac-413b-8339-caed4616c135 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:02.204186 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-b07857c3-56ac-413b-8339-caed4616c135 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:02.226162 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4e1fda51-ec0c-46aa-977c-39ff24d9084f req-f57d6812-2b65-4031-b476-326de644589f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:02.231294 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-b07857c3-56ac-413b-8339-caed4616c135 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2074130 Dec 09 14:45:02.239460 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['746ea6aa-be43-4fbf-9463-02d741db305a'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:45:02.268386 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Request body: {'port': {'device_id': 'd798c281-d19b-4602-8aea-7542278bcd34', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:45:02.274658 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f57d6812-2b65-4031-b476-326de644589f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Pushing event deleted for resources: {'Port': ['ID=746ea6aa-be43-4fbf-9463-02d741db305a,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:02.363242 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-4e1fda51-ec0c-46aa-977c-39ff24d9084f req-f57d6812-2b65-4031-b476-326de644589f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] No DVR routers for this DVR port 746ea6aa-be43-4fbf-9463-02d741db305a on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:45:02.367270 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-4e1fda51-ec0c-46aa-977c-39ff24d9084f req-f57d6812-2b65-4031-b476-326de644589f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:02.371191 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4e1fda51-ec0c-46aa-977c-39ff24d9084f req-f57d6812-2b65-4031-b476-326de644589f tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.44 "DELETE /v2.0/ports/746ea6aa-be43-4fbf-9463-02d741db305a HTTP/1.1" status: 204 len: 173 time: 1.0084264 Dec 09 14:45:02.371686 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c97d018e-9866-4c56-8334-267a2c2c4465', 'name': 'network-vif-deleted', 'tag': '746ea6aa-be43-4fbf-9463-02d741db305a'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:45:02.374038 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-487dea0b-b0c8-4829-8bde-b57322aab4ee" -d '{"events": [{"server_uuid": "c97d018e-9866-4c56-8334-267a2c2c4465", "name": "network-vif-deleted", "tag": "746ea6aa-be43-4fbf-9463-02d741db305a"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:45:02.385920 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:02.443853 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:45:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5954baf6-1100-4583-b313-e0b56c1734e5 x-openstack-request-id: req-5954baf6-1100-4583-b313-e0b56c1734e5 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:45:02.444145 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c97d018e-9866-4c56-8334-267a2c2c4465", "name": "network-vif-deleted", "tag": "746ea6aa-be43-4fbf-9463-02d741db305a", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:45:02.444399 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-5954baf6-1100-4583-b313-e0b56c1734e5 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:45:02.444810 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c97d018e-9866-4c56-8334-267a2c2c4465', 'name': 'network-vif-deleted', 'tag': '746ea6aa-be43-4fbf-9463-02d741db305a', 'status': 'completed', 'code': 200} Dec 09 14:45:02.635047 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:02.742024 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5dd18c35-7663-4f55-b8d5-d9a873073de1 req-ff3afdc4-c4d5-416a-99c8-e1514e4e46f1 tempest-AttachVolumeNegativeTest-326989734 tempest-AttachVolumeNegativeTest-326989734-project] 10.222.0.39 "GET /v2.0/ports?device_id=c97d018e-9866-4c56-8334-267a2c2c4465 HTTP/1.1" status: 200 len: 210 time: 0.0736117 Dec 09 14:45:02.799490 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14f04f58-5295-49b7-acb4-2d1caa7237cd req-86f0f792-d4f7-4acb-9137-e1b0d29f337d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:02.801257 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-14f04f58-5295-49b7-acb4-2d1caa7237cd req-86f0f792-d4f7-4acb-9137-e1b0d29f337d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0710983 Dec 09 14:45:02.846499 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0576450-bfef-4903-92db-49df7dbb3496 req-6d585df8-a3a9-447f-a931-7929e8d7a660 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:02.848053 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e0576450-bfef-4903-92db-49df7dbb3496 req-6d585df8-a3a9-447f-a931-7929e8d7a660 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=3d298e3ebec54c2281ddf8bbb50b7cea&device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 1098 time: 0.0984638 Dec 09 14:45:02.869280 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-14f04f58-5295-49b7-acb4-2d1caa7237cd req-c938a0cf-0c9e-4e9f-97b3-d2ab7a0702b9 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0613472 Dec 09 14:45:02.971450 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 15210d7b-a185-432f-9885-014d180eb6b9 {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:45:02.981652 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:03.030932 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Transition to ACTIVE for port object 15210d7b-a185-432f-9885-014d180eb6b9 will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:45:03.044712 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:03.154880 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1bb89ac-0ab0-4ee2-91f1-829eface1694 req-68e37b9b-a96b-48e7-8ef9-5092dd42ab38 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:03.156691 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f1bb89ac-0ab0-4ee2-91f1-829eface1694 req-68e37b9b-a96b-48e7-8ef9-5092dd42ab38 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 931 time: 0.2448719 Dec 09 14:45:03.185291 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Pushing event updated for resources: {'Port': ['ID=15210d7b-a185-432f-9885-014d180eb6b9,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:03.210749 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0576450-bfef-4903-92db-49df7dbb3496 req-aa545233-d8ae-4d67-ad0d-633104ab4f1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:03.212537 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e0576450-bfef-4903-92db-49df7dbb3496 req-aa545233-d8ae-4d67-ad0d-633104ab4f1d service neutron] 10.222.0.44 "GET /v2.0/networks?id=8ff38a1e-5122-4806-8b7d-d4c281cbe550 HTTP/1.1" status: 200 len: 919 time: 0.3131034 Dec 09 14:45:03.227201 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee51ab9a-3c82-41ab-bb8c-c6a31c9dd014 req-2ffa3465-9add-44a8-af69-4c6e4c71a96b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:03.229118 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ee51ab9a-3c82-41ab-bb8c-c6a31c9dd014 req-2ffa3465-9add-44a8-af69-4c6e4c71a96b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0518603 Dec 09 14:45:03.293447 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ee51ab9a-3c82-41ab-bb8c-c6a31c9dd014 req-f9368d2e-48d5-43ed-aad6-3361ed38f5f0 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0575891 Dec 09 14:45:03.332349 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e0576450-bfef-4903-92db-49df7dbb3496 req-9766630a-7ce7-47dc-b97e-e1c99ceba428 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=bb290a6d-709a-49d1-bd2e-10c0fe664657 HTTP/1.1" status: 200 len: 217 time: 0.0751708 Dec 09 14:45:03.357631 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f1bb89ac-0ab0-4ee2-91f1-829eface1694 req-3e9b59e8-006d-42ec-b1f2-2cfbd8ed80a8 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1891015 Dec 09 14:45:03.413341 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Attempting to bind port 15210d7b-a185-432f-9885-014d180eb6b9 on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:45:03.413677 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Attempting to bind port 15210d7b-a185-432f-9885-014d180eb6b9 by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': 'e2f74911-9ec7-4d46-b689-ab5ae0cbb567', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 421, 'network_id': '8ae9a24a-645d-43a9-b32c-41629b26c09e'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:45:03.414016 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Attempting to bind port 15210d7b-a185-432f-9885-014d180eb6b9 on network 8ae9a24a-645d-43a9-b32c-41629b26c09e {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:45:03.420210 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0576450-bfef-4903-92db-49df7dbb3496 req-4240897a-1633-4236-9c6a-e482dd1a8dc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:03.421732 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e0576450-bfef-4903-92db-49df7dbb3496 req-4240897a-1633-4236-9c6a-e482dd1a8dc4 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=90388423-2d07-4cbe-80d8-fa2f6a3c14f7 HTTP/1.1" status: 200 len: 858 time: 0.0770068 Dec 09 14:45:03.424873 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Port 15210d7b-a185-432f-9885-014d180eb6b9 on network 8ae9a24a-645d-43a9-b32c-41629b26c09e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:45:03.425205 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Attempting to bind port 15210d7b-a185-432f-9885-014d180eb6b9 on network 8ae9a24a-645d-43a9-b32c-41629b26c09e {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:45:03.432062 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 44, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:45:03.432370 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Checking segment: {'id': 'e2f74911-9ec7-4d46-b689-ab5ae0cbb567', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 421, 'network_id': '8ae9a24a-645d-43a9-b32c-41629b26c09e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:45:03.432764 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Bound using segment: {'id': 'e2f74911-9ec7-4d46-b689-ab5ae0cbb567', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 421, 'network_id': '8ae9a24a-645d-43a9-b32c-41629b26c09e'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:45:03.433199 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Bound port: 15210d7b-a185-432f-9885-014d180eb6b9, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e2f74911-9ec7-4d46-b689-ab5ae0cbb567', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 421, 'network_id': '8ae9a24a-645d-43a9-b32c-41629b26c09e'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:45:03.433567 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:03.458528 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514829e8-d65e-41b6-a1ac-f05abf58deb4 req-573490d5-a1d1-4517-ad49-f398d1f79ea9 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:03.460304 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-514829e8-d65e-41b6-a1ac-f05abf58deb4 req-573490d5-a1d1-4517-ad49-f398d1f79ea9 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0743253 Dec 09 14:45:03.470698 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e0576450-bfef-4903-92db-49df7dbb3496 req-fe64af91-d867-40a3-9527-67bcb4b0f60e service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=8ff38a1e-5122-4806-8b7d-d4c281cbe550&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0397000 Dec 09 14:45:03.539152 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-514829e8-d65e-41b6-a1ac-f05abf58deb4 req-dcfbcc50-6f7b-4134-b71a-1b81c3ec5185 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0717354 Dec 09 14:45:03.601348 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] For port 15210d7b-a185-432f-9885-014d180eb6b9, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:45:03.624737 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] For port 15210d7b-a185-432f-9885-014d180eb6b9, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=15210d7b-a185-432f-9885-014d180eb6b9,segment=NetworkSegment(e2f74911-9ec7-4d46-b689-ab5ae0cbb567),segment_id=e2f74911-9ec7-4d46-b689-ab5ae0cbb567)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:45:03.641836 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:03.677698 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e0576450-bfef-4903-92db-49df7dbb3496 req-e854a6f7-2918-49ae-a0f0-abdd777f5ec3 service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1969383 Dec 09 14:45:03.689238 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:03.690340 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:03.691844 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] 10.222.0.44 "PUT /v2.0/ports/15210d7b-a185-432f-9885-014d180eb6b9 HTTP/1.1" status: 200 len: 1093 time: 1.4286246 Dec 09 14:45:03.814253 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 56554) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:03.871591 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_v2 [None req-1056349e-624c-4280-84a5-d67497b025b8 admin admin] Deleting subnet 7c6b4bb0-bfec-44d0-8503-70917540b3c5 {{(pid=109062) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:45:03.875724 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1056349e-624c-4280-84a5-d67497b025b8 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:03.929577 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1056349e-624c-4280-84a5-d67497b025b8 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-130415749'] for subnet, precommit_delete_associations {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:04.050008 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1056349e-624c-4280-84a5-d67497b025b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:04.060445 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-319125a8-dae8-4c1e-8d01-70062bdf8b95 service neutron] Pushing event updated for resources: {'Port': ['ID=15210d7b-a185-432f-9885-014d180eb6b9,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:04.085284 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb08f975-0a4d-434c-aa10-e0827b8b05cc req-0a5b23eb-7262-420c-a0d7-61ffb5fe9c97 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:04.086937 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fb08f975-0a4d-434c-aa10-e0827b8b05cc req-0a5b23eb-7262-420c-a0d7-61ffb5fe9c97 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.1145241 Dec 09 14:45:04.108835 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-1c61db30-de1a-446f-9c02-a53d7777c8e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:04.111359 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-1c61db30-de1a-446f-9c02-a53d7777c8e6 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=3b3199edde77497bbdb703336ce72b78&device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 1096 time: 0.3456435 Dec 09 14:45:04.167210 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1056349e-624c-4280-84a5-d67497b025b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-130461228', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-130768914'] for subnet, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:04.173212 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-f6b591d0-b5b0-414f-918d-c93c1c94c332 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=15210d7b-a185-432f-9885-014d180eb6b9 HTTP/1.1" status: 200 len: 217 time: 0.0462384 Dec 09 14:45:04.175271 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e0576450-bfef-4903-92db-49df7dbb3496 req-6027a8da-aa2f-4b31-b77c-785a16078af3 service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4807231 Dec 09 14:45:04.179711 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fb08f975-0a4d-434c-aa10-e0827b8b05cc req-dc47fa88-378a-4790-ac9f-ec370370c196 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0825026 Dec 09 14:45:04.208279 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1056349e-624c-4280-84a5-d67497b025b8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:04.212060 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-1056349e-624c-4280-84a5-d67497b025b8 admin admin] 10.222.0.39 "DELETE /v2.0/subnets/7c6b4bb0-bfec-44d0-8503-70917540b3c5 HTTP/1.1" status: 204 len: 168 time: 0.3959353 Dec 09 14:45:04.213156 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1056349e-624c-4280-84a5-d67497b025b8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7c6b4bb0-bfec-44d0-8503-70917540b3c5,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:04.218793 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 56564) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:04.257209 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-14ef7e92-746e-4fee-9316-a4c366097489 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:04.258952 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-14ef7e92-746e-4fee-9316-a4c366097489 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=a44bb60f-825d-4a27-a5af-fbe9e6e78fb7 HTTP/1.1" status: 200 len: 854 time: 0.0623674 Dec 09 14:45:04.300198 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-b41bfc5d-475c-44c3-93bb-262ab15e29aa service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=8ae9a24a-645d-43a9-b32c-41629b26c09e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0265911 Dec 09 14:45:04.303635 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cfb22043-4818-4886-aac6-c7d637d39d51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:04.396307 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cfb22043-4818-4886-aac6-c7d637d39d51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:04.424683 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-1def6fa4-7255-4113-8bfd-86827e9fa380 service neutron] 10.222.0.44 "GET /v2.0/networks/8ae9a24a-645d-43a9-b32c-41629b26c09e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1076944 Dec 09 14:45:04.437572 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-cfb22043-4818-4886-aac6-c7d637d39d51 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d']}} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:04.457382 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd798c281-d19b-4602-8aea-7542278bcd34', 'tag': '15210d7b-a185-432f-9885-014d180eb6b9'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:45:04.458747 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-cfb22043-4818-4886-aac6-c7d637d39d51 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'f11d9e19-2d99-4f20-a186-cdaeddb729de') {'for_net_delete': True} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:04.459144 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-cfb22043-4818-4886-aac6-c7d637d39d51 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'f11d9e19-2d99-4f20-a186-cdaeddb729de') {} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:04.459799 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-53a94f0c-32b6-477c-93df-bcd6f19e7c31" -d '{"events": [{"name": "network-changed", "server_uuid": "d798c281-d19b-4602-8aea-7542278bcd34", "tag": "15210d7b-a185-432f-9885-014d180eb6b9"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:45:04.483265 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cfb22043-4818-4886-aac6-c7d637d39d51 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-130415758'] for segment, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:04.501699 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cfb22043-4818-4886-aac6-c7d637d39d51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:04.510462 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cfb22043-4818-4886-aac6-c7d637d39d51 admin admin] Releasing vlan 405 on physical network physnet1 to pool {{(pid=109062) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:45:04.511137 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cfb22043-4818-4886-aac6-c7d637d39d51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-130461398'] for segment, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: Traceback (most recent call last): Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: timer() Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: cb(*args, **kw) Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: return func(*args, **kwargs) Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: self._notify() Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: self.callback(batched_events) Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: event.method(event) Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: return f(self, *a, **k) Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._get(url).json() Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: return self.request(url, 'GET', **kwargs) Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:45:04.513067 dv-cinder-819692-8-iscsi neutron-server[109062]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:45:04.560630 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3e10320-b86e-4663-8992-8be4588c7047 req-9fcbf5f7-d2dc-40e1-8846-a8e20b9b2f6b tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:04.561422 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7619be13-4477-4b6c-8ec4-79ab6e0d88e4 req-ec5d2b39-dc50-427a-a8d4-a7a6e1a2dd77 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:04.562227 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b3e10320-b86e-4663-8992-8be4588c7047 req-9fcbf5f7-d2dc-40e1-8846-a8e20b9b2f6b tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 943 time: 0.1214070 Dec 09 14:45:04.563370 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7619be13-4477-4b6c-8ec4-79ab6e0d88e4 req-ec5d2b39-dc50-427a-a8d4-a7a6e1a2dd77 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.1387472 Dec 09 14:45:04.621077 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cfb22043-4818-4886-aac6-c7d637d39d51 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:04.629335 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1aea2295-052f-4d96-a715-e51a65c9aa33 req-b60d6ee1-1a9b-408d-90f2-847daafd1d0f service neutron] 10.222.0.44 "GET /v2.0/networks/8ae9a24a-645d-43a9-b32c-41629b26c09e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1652932 Dec 09 14:45:04.646541 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b3e10320-b86e-4663-8992-8be4588c7047 req-86fa4c0a-0208-4102-bb1f-f9b929a16e37 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0627484 Dec 09 14:45:04.647840 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cfb22043-4818-4886-aac6-c7d637d39d51 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:04.654859 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-cfb22043-4818-4886-aac6-c7d637d39d51 admin admin] 10.222.0.39 "DELETE /v2.0/networks/99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d HTTP/1.1" status: 204 len: 168 time: 0.4324429 Dec 09 14:45:04.654859 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfb22043-4818-4886-aac6-c7d637d39d51 admin admin] Pushing event deleted for resources: {'Network': ['ID=99cebbfc-1b8b-49b2-9dca-b646f5e3fe5d,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:04.680991 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7619be13-4477-4b6c-8ec4-79ab6e0d88e4 req-a8ac59e3-2a2e-4e20-84da-410eb662b50c tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0896633 Dec 09 14:45:04.697760 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:45:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ea686368-1d73-4bca-be2a-622d20284f38 x-openstack-request-id: req-ea686368-1d73-4bca-be2a-622d20284f38 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:45:04.698154 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d798c281-d19b-4602-8aea-7542278bcd34", "tag": "15210d7b-a185-432f-9885-014d180eb6b9", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:45:04.698511 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-ea686368-1d73-4bca-be2a-622d20284f38 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:45:04.699028 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd798c281-d19b-4602-8aea-7542278bcd34', 'tag': '15210d7b-a185-432f-9885-014d180eb6b9', 'status': 'completed', 'code': 200} Dec 09 14:45:04.776584 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a94f0c-32b6-477c-93df-bcd6f19e7c31 req-8b8e05e6-0301-47d0-9f02-87154df57003 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:04.779264 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-53a94f0c-32b6-477c-93df-bcd6f19e7c31 req-8b8e05e6-0301-47d0-9f02-87154df57003 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=3b3199edde77497bbdb703336ce72b78&device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 1096 time: 0.0521791 Dec 09 14:45:04.847953 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2076f42-d5ba-4404-8c7c-81a1f7b2dc1a req-5a23c68f-446c-4357-a92f-c92103a6994f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:04.857993 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f2076f42-d5ba-4404-8c7c-81a1f7b2dc1a req-5a23c68f-446c-4357-a92f-c92103a6994f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0676899 Dec 09 14:45:04.859871 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 56580) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:04.886820 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a94f0c-32b6-477c-93df-bcd6f19e7c31 req-693df474-7909-4301-a252-5cae529000a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:04.888677 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-53a94f0c-32b6-477c-93df-bcd6f19e7c31 req-693df474-7909-4301-a252-5cae529000a1 service neutron] 10.222.0.44 "GET /v2.0/networks?id=8ae9a24a-645d-43a9-b32c-41629b26c09e HTTP/1.1" status: 200 len: 915 time: 0.1019442 Dec 09 14:45:04.933779 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f2076f42-d5ba-4404-8c7c-81a1f7b2dc1a req-cc121181-1c40-43fb-aa74-3be1e96e709d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0747957 Dec 09 14:45:04.936100 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-d10b33ee-597a-4eab-8d52-5d9461b4fc3e admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=5ec989b7fd3e45f2b8962e012b0797ac&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0701866 Dec 09 14:45:04.938639 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 56582) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:04.959087 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-53a94f0c-32b6-477c-93df-bcd6f19e7c31 req-1d2efa9a-1989-4f59-920f-308930492f2d service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=15210d7b-a185-432f-9885-014d180eb6b9 HTTP/1.1" status: 200 len: 217 time: 0.0554276 Dec 09 14:45:04.998884 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5342e322-c900-4e45-9bde-099e018743be admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:05.020407 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a94f0c-32b6-477c-93df-bcd6f19e7c31 req-6098a1d3-9ac3-4674-9e3e-99199853d81c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:05.022318 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-53a94f0c-32b6-477c-93df-bcd6f19e7c31 req-6098a1d3-9ac3-4674-9e3e-99199853d81c service neutron] 10.222.0.44 "GET /v2.0/subnets?id=a44bb60f-825d-4a27-a5af-fbe9e6e78fb7 HTTP/1.1" status: 200 len: 854 time: 0.0543940 Dec 09 14:45:05.024446 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5342e322-c900-4e45-9bde-099e018743be admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:05.032890 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 746ea6aa-be43-4fbf-9463-02d741db305a no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:45:05.055677 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: 746ea6aa-be43-4fbf-9463-02d741db305a {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:45:05.056381 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 746ea6aa-be43-4fbf-9463-02d741db305a not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:45:05.067908 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-53a94f0c-32b6-477c-93df-bcd6f19e7c31 req-4fe53aa0-a10f-4b57-95cb-880dcf237ab9 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=8ae9a24a-645d-43a9-b32c-41629b26c09e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0358653 Dec 09 14:45:05.078219 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5342e322-c900-4e45-9bde-099e018743be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:05.081645 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5342e322-c900-4e45-9bde-099e018743be admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:05.082935 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-5342e322-c900-4e45-9bde-099e018743be admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/8fcac96f-cc33-4e38-a206-df35f6e6373e HTTP/1.1" status: 204 len: 168 time: 0.1432180 Dec 09 14:45:05.095053 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5342e322-c900-4e45-9bde-099e018743be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8fcac96f-cc33-4e38-a206-df35f6e6373e,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:05.192029 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-53a94f0c-32b6-477c-93df-bcd6f19e7c31 req-35435aca-ec13-4c76-9a8f-e59448a08451 service neutron] 10.222.0.44 "GET /v2.0/networks/8ae9a24a-645d-43a9-b32c-41629b26c09e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1124265 Dec 09 14:45:05.310484 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-53a94f0c-32b6-477c-93df-bcd6f19e7c31 req-6e040603-98b8-4bdf-9240-53f8fa8a34e1 service neutron] 10.222.0.44 "GET /v2.0/networks/8ae9a24a-645d-43a9-b32c-41629b26c09e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1081958 Dec 09 14:45:05.365499 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2b2cc15-8053-494d-bac6-721cff0c93a3 req-26baf877-62f2-42c3-8521-39e1fa86e341 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:05.367006 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a2b2cc15-8053-494d-bac6-721cff0c93a3 req-26baf877-62f2-42c3-8521-39e1fa86e341 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0728498 Dec 09 14:45:05.437258 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a2b2cc15-8053-494d-bac6-721cff0c93a3 req-3b3e88d1-1eae-49bc-81fe-9a7630985957 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583069 Dec 09 14:45:05.806400 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8237b9fb-62c3-4ce5-a389-d1efe157eeb7 req-bf2ec5a6-f50a-4c2c-8eb9-5cde2e365feb tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:05.813790 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8237b9fb-62c3-4ce5-a389-d1efe157eeb7 req-bf2ec5a6-f50a-4c2c-8eb9-5cde2e365feb tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 943 time: 0.0672681 Dec 09 14:45:05.875887 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8237b9fb-62c3-4ce5-a389-d1efe157eeb7 req-0db97544-0c6a-4501-bce6-571356a5e565 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0610545 Dec 09 14:45:05.892562 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4470f0b7-86e9-4de2-8e54-79f62fa6dc02 req-9528c6c6-c98c-4343-a022-b813dc0b76a6 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:05.896149 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4470f0b7-86e9-4de2-8e54-79f62fa6dc02 req-9528c6c6-c98c-4343-a022-b813dc0b76a6 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.1081975 Dec 09 14:45:05.954089 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4470f0b7-86e9-4de2-8e54-79f62fa6dc02 req-195c57cc-ad08-4957-b86f-234b0400a8da tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0504284 Dec 09 14:45:06.086917 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bea6a499-7916-4306-9ac9-0636bb63a203 req-f8194332-249f-4a9c-b844-93f888c4cbf5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:06.094515 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-bea6a499-7916-4306-9ac9-0636bb63a203 req-f8194332-249f-4a9c-b844-93f888c4cbf5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0642645 Dec 09 14:45:06.149117 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-bea6a499-7916-4306-9ac9-0636bb63a203 req-ce93ace7-7fdc-40bd-9e21-766d6e8b2489 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0506458 Dec 09 14:45:06.564227 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c41c2b7b-96a2-4938-8bd0-f0e1baff5e0a req-564de635-4b8e-4a59-8ef3-7ee82588b9bc tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:06.566990 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c41c2b7b-96a2-4938-8bd0-f0e1baff5e0a req-564de635-4b8e-4a59-8ef3-7ee82588b9bc tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0635095 Dec 09 14:45:06.627106 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c41c2b7b-96a2-4938-8bd0-f0e1baff5e0a req-d2c571c3-69b7-40ea-b7e4-fac3e1b17dc3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529685 Dec 09 14:45:07.039372 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 15210d7b-a185-432f-9885-014d180eb6b9 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:45:07.047667 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d314a9b7-06a2-4b03-84a5-a38f88f79bf8 req-e687321a-8a4f-4775-bda2-036fbdfd3b6c tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:07.049852 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d314a9b7-06a2-4b03-84a5-a38f88f79bf8 req-e687321a-8a4f-4775-bda2-036fbdfd3b6c tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 943 time: 0.0927491 Dec 09 14:45:07.134132 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-401b94ec-0e18-4bba-ba59-10237979d68c req-94da10c0-9ecd-4092-a80f-f2769b3c1598 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:07.146093 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-401b94ec-0e18-4bba-ba59-10237979d68c req-94da10c0-9ecd-4092-a80f-f2769b3c1598 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0839982 Dec 09 14:45:07.177804 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d314a9b7-06a2-4b03-84a5-a38f88f79bf8 req-df1461a0-9169-4d8e-9898-0a9e2eb7c840 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1046355 Dec 09 14:45:07.203638 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 15210d7b-a185-432f-9885-014d180eb6b9, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=15210d7b-a185-432f-9885-014d180eb6b9,segment=NetworkSegment(e2f74911-9ec7-4d46-b689-ab5ae0cbb567),segment_id=e2f74911-9ec7-4d46-b689-ab5ae0cbb567)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:45:07.222270 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': '15210d7b-a185-432f-9885-014d180eb6b9', 'network_id': '8ae9a24a-645d-43a9-b32c-41629b26c09e', 'port_id': '15210d7b-a185-432f-9885-014d180eb6b9', 'mac_address': 'fa:16:3e:52:70:ea', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 421, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a44bb60f-825d-4a27-a5af-fbe9e6e78fb7', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:45:07.254438 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-401b94ec-0e18-4bba-ba59-10237979d68c req-663d266e-5f63-4bbd-a3c1-ad6109e12217 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1074183 Dec 09 14:45:07.273639 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:07.298334 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 15210d7b-a185-432f-9885-014d180eb6b9 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:45:07.324498 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 15210d7b-a185-432f-9885-014d180eb6b9, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=15210d7b-a185-432f-9885-014d180eb6b9,segment=NetworkSegment(e2f74911-9ec7-4d46-b689-ab5ae0cbb567),segment_id=e2f74911-9ec7-4d46-b689-ab5ae0cbb567)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:45:07.330873 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcd5f48a-4e8d-4a19-a46c-0b3035353a38 req-12eada87-9a6d-4634-941c-2e69382b55d8 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:07.333741 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:07.338699 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-dcd5f48a-4e8d-4a19-a46c-0b3035353a38 req-12eada87-9a6d-4634-941c-2e69382b55d8 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0976081 Dec 09 14:45:07.403658 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=15210d7b-a185-432f-9885-014d180eb6b9,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:07.406227 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 56652) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:07.426346 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-dcd5f48a-4e8d-4a19-a46c-0b3035353a38 req-023e3c3b-2dab-44fc-9b73-d8f535d60078 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0830247 Dec 09 14:45:07.531459 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3d3a74b8-e2bb-4b4b-a876-14d4e256a6c6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:07.615883 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3d3a74b8-e2bb-4b4b-a876-14d4e256a6c6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:07.622246 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3d3a74b8-e2bb-4b4b-a876-14d4e256a6c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:07.654064 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['15210d7b-a185-432f-9885-014d180eb6b9'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:45:07.684419 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-3d3a74b8-e2bb-4b4b-a876-14d4e256a6c6 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=a89b0b0b1513492597d24204e91ec796&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2769616 Dec 09 14:45:07.689436 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d3a74b8-e2bb-4b4b-a876-14d4e256a6c6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7d2a845b-c322-4c0f-b7f4-dbbe10095ba3,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:07.691152 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 56658) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:07.779649 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3e475c99-10ac-445b-a363-4981b7541867 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:07.808440 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3e475c99-10ac-445b-a363-4981b7541867 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:07.824273 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff356424-42cb-4807-b2c8-6ba723fff509 req-df623952-850e-4b76-9e47-4b299ce23a8b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:07.837362 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ff356424-42cb-4807-b2c8-6ba723fff509 req-df623952-850e-4b76-9e47-4b299ce23a8b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0785818 Dec 09 14:45:07.890859 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3e475c99-10ac-445b-a363-4981b7541867 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:07.895713 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3e475c99-10ac-445b-a363-4981b7541867 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:07.897094 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-3e475c99-10ac-445b-a363-4981b7541867 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/7d2a845b-c322-4c0f-b7f4-dbbe10095ba3 HTTP/1.1" status: 204 len: 168 time: 0.2055321 Dec 09 14:45:07.904845 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ff356424-42cb-4807-b2c8-6ba723fff509 req-930e4665-1cdf-419c-8f9b-eb8af15cbaf9 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665808 Dec 09 14:45:07.909731 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e475c99-10ac-445b-a363-4981b7541867 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7d2a845b-c322-4c0f-b7f4-dbbe10095ba3,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:08.266184 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 56670) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:08.283582 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-927e04e7-c1a0-48b8-a79d-76da8ce2ad07 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:08.294338 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10e97bdd-376b-4674-a223-748270b5d115 req-99641d8d-8568-4e49-b5df-e87ee63295ec tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:08.302497 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-10e97bdd-376b-4674-a223-748270b5d115 req-99641d8d-8568-4e49-b5df-e87ee63295ec tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 944 time: 0.0684881 Dec 09 14:45:08.358257 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-10e97bdd-376b-4674-a223-748270b5d115 req-42f63fe9-5c12-43ec-95dc-a00d38d6a173 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0546842 Dec 09 14:45:08.458332 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1da7fd0f-1b5d-492c-be2a-f7923772a4de req-fa8002e1-2c6b-445c-8b57-b609f0d9f796 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:08.459996 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1da7fd0f-1b5d-492c-be2a-f7923772a4de req-fa8002e1-2c6b-445c-8b57-b609f0d9f796 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0780749 Dec 09 14:45:08.462204 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-927e04e7-c1a0-48b8-a79d-76da8ce2ad07 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:08.471054 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-927e04e7-c1a0-48b8-a79d-76da8ce2ad07 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:08.528627 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-927e04e7-c1a0-48b8-a79d-76da8ce2ad07 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=c050a6a45cdb40c9861bcc0fd30dbc7b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2587688 Dec 09 14:45:08.528864 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-927e04e7-c1a0-48b8-a79d-76da8ce2ad07 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=61cafc15-dbe8-4856-b80b-e91ea3bdfff0,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:08.531218 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 56678) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:08.581758 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1da7fd0f-1b5d-492c-be2a-f7923772a4de req-3fcd4db1-8938-4584-91ff-e2c952758c74 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1123972 Dec 09 14:45:08.582151 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75120cb7-bc16-4a8a-8d24-ffb87cf33991 req-6486bba2-5c7c-4990-8572-6360cac97d98 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:08.583794 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-75120cb7-bc16-4a8a-8d24-ffb87cf33991 req-6486bba2-5c7c-4990-8572-6360cac97d98 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0606279 Dec 09 14:45:08.604776 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2604456f-c4fe-4724-9505-e4a0146f52ee admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:08.632608 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2604456f-c4fe-4724-9505-e4a0146f52ee admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:08.648112 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-75120cb7-bc16-4a8a-8d24-ffb87cf33991 req-975814c2-0ed3-4c60-90bf-c03ff7bb3805 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520048 Dec 09 14:45:08.685246 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2604456f-c4fe-4724-9505-e4a0146f52ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:08.689443 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2604456f-c4fe-4724-9505-e4a0146f52ee admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:08.694113 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-2604456f-c4fe-4724-9505-e4a0146f52ee admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/61cafc15-dbe8-4856-b80b-e91ea3bdfff0 HTTP/1.1" status: 204 len: 168 time: 0.1576092 Dec 09 14:45:08.699895 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2604456f-c4fe-4724-9505-e4a0146f52ee admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=61cafc15-dbe8-4856-b80b-e91ea3bdfff0,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:09.028857 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fa15258-72a5-4ea0-8712-0a15ffc29bc9 req-56df02f2-2acc-4e0c-8800-3fe768b8e758 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:09.030392 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5fa15258-72a5-4ea0-8712-0a15ffc29bc9 req-56df02f2-2acc-4e0c-8800-3fe768b8e758 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0495067 Dec 09 14:45:09.045547 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 15210d7b-a185-432f-9885-014d180eb6b9 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:45:09.105423 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5fa15258-72a5-4ea0-8712-0a15ffc29bc9 req-49ed55a5-af14-4f18-8445-8b77b9f1cb62 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0690615 Dec 09 14:45:09.109921 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port 15210d7b-a185-432f-9885-014d180eb6b9 completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:45:09.115040 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port 15210d7b-a185-432f-9885-014d180eb6b9 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:09.115419 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:09.192001 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:09.221194 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd798c281-d19b-4602-8aea-7542278bcd34', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15210d7b-a185-432f-9885-014d180eb6b9'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:45:09.223434 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-821d805c-2610-4a80-a47d-04fb281ff34a" -d '{"events": [{"server_uuid": "d798c281-d19b-4602-8aea-7542278bcd34", "name": "network-vif-plugged", "status": "completed", "tag": "15210d7b-a185-432f-9885-014d180eb6b9"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:45:09.236594 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 15210d7b-a185-432f-9885-014d180eb6b9, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=15210d7b-a185-432f-9885-014d180eb6b9,segment=NetworkSegment(e2f74911-9ec7-4d46-b689-ab5ae0cbb567),segment_id=e2f74911-9ec7-4d46-b689-ab5ae0cbb567)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:45:09.242196 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:09.270916 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d1649e7-e574-49d4-961e-8bf0e3a9da9f req-a56a4abc-c392-4382-884a-cde19cedda41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:09.271263 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:45:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7c9216ef-d4ac-4b91-9aac-ff73f02c96ee x-openstack-request-id: req-7c9216ef-d4ac-4b91-9aac-ff73f02c96ee {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:45:09.271573 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d798c281-d19b-4602-8aea-7542278bcd34", "name": "network-vif-plugged", "status": "completed", "tag": "15210d7b-a185-432f-9885-014d180eb6b9", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:45:09.271890 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-7c9216ef-d4ac-4b91-9aac-ff73f02c96ee {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:45:09.272244 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd798c281-d19b-4602-8aea-7542278bcd34', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '15210d7b-a185-432f-9885-014d180eb6b9', 'code': 200} Dec 09 14:45:09.273253 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4d1649e7-e574-49d4-961e-8bf0e3a9da9f req-a56a4abc-c392-4382-884a-cde19cedda41 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=6be5d78d2d0049448c3947b4e650758a&device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 1099 time: 0.0631800 Dec 09 14:45:09.305126 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=15210d7b-a185-432f-9885-014d180eb6b9,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:09.389848 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d1649e7-e574-49d4-961e-8bf0e3a9da9f req-1dc46502-8322-4f87-94a7-f23825fcaf74 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:09.391404 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4d1649e7-e574-49d4-961e-8bf0e3a9da9f req-1dc46502-8322-4f87-94a7-f23825fcaf74 service neutron] 10.222.0.44 "GET /v2.0/networks?id=9ab3f8b6-44d0-4210-907d-0e96072c4566 HTTP/1.1" status: 200 len: 917 time: 0.1059523 Dec 09 14:45:09.531638 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4d1649e7-e574-49d4-961e-8bf0e3a9da9f req-a1ed63e6-f464-4fb2-9aaa-8563ec8191a0 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 HTTP/1.1" status: 200 len: 1002 time: 0.1208839 Dec 09 14:45:09.556078 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-941dd159-c51e-475f-8db3-7169e7866982 req-39110c26-09e6-4ab5-9d90-7ec17d079e00 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:09.557512 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-941dd159-c51e-475f-8db3-7169e7866982 req-39110c26-09e6-4ab5-9d90-7ec17d079e00 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 945 time: 0.1069927 Dec 09 14:45:09.579666 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfffa315-03bf-4bd0-938e-4be1685b5070 req-d3a1ed30-09cd-4062-a43a-404cbf7d5285 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:09.581108 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfffa315-03bf-4bd0-938e-4be1685b5070 req-d3a1ed30-09cd-4062-a43a-404cbf7d5285 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 1098 time: 0.1293716 Dec 09 14:45:09.638386 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d1649e7-e574-49d4-961e-8bf0e3a9da9f req-ff4dda33-1edc-4a39-b9d9-5e5c9f1da0e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:09.639793 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4d1649e7-e574-49d4-961e-8bf0e3a9da9f req-ff4dda33-1edc-4a39-b9d9-5e5c9f1da0e8 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=f10f1097-5d43-4737-bcac-a27ade66b442 HTTP/1.1" status: 200 len: 855 time: 0.0995190 Dec 09 14:45:09.695746 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-941dd159-c51e-475f-8db3-7169e7866982 req-66b547f2-60f1-4a9f-b987-ea851ba8088a tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1185758 Dec 09 14:45:09.706522 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfffa315-03bf-4bd0-938e-4be1685b5070 req-1c9e6ed1-8d35-4585-b8ed-bf131e911965 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1153316 Dec 09 14:45:09.713679 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f40a0db-47ea-4c35-8ae0-c62710f8d439 req-e205a220-94eb-4e09-a357-ec0957152c03 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:09.715225 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6f40a0db-47ea-4c35-8ae0-c62710f8d439 req-e205a220-94eb-4e09-a357-ec0957152c03 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0577343 Dec 09 14:45:09.724447 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d1649e7-e574-49d4-961e-8bf0e3a9da9f req-25223fea-76cc-473d-861e-1132ff78c51c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:09.726484 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4d1649e7-e574-49d4-961e-8bf0e3a9da9f req-25223fea-76cc-473d-861e-1132ff78c51c service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=9ab3f8b6-44d0-4210-907d-0e96072c4566&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0741014 Dec 09 14:45:09.767918 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6f40a0db-47ea-4c35-8ae0-c62710f8d439 req-90da9fef-3524-46d6-bd3c-418112ecaac4 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463622 Dec 09 14:45:09.827445 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3838022-4158-45df-8a80-1ddf49e36c9b req-d58db682-3d5a-4373-8136-e4e24469b91d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:09.828937 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a3838022-4158-45df-8a80-1ddf49e36c9b req-d58db682-3d5a-4373-8136-e4e24469b91d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0531709 Dec 09 14:45:09.879464 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a3838022-4158-45df-8a80-1ddf49e36c9b req-24a0ac29-5302-4c81-92d8-e851a42ae6d3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446131 Dec 09 14:45:09.989999 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4d1649e7-e574-49d4-961e-8bf0e3a9da9f req-3cdd3faa-46a9-4de3-9950-d193811a0887 service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834713 Dec 09 14:45:10.087472 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4d1649e7-e574-49d4-961e-8bf0e3a9da9f req-f7631040-681b-4553-b3ea-120734f3e085 service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886416 Dec 09 14:45:10.221926 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91141fc1-58b7-46fb-972e-abbb8c23d566 req-7cfd7d49-0414-4210-9ffb-8ff1ecca74ae tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:10.223418 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-91141fc1-58b7-46fb-972e-abbb8c23d566 req-7cfd7d49-0414-4210-9ffb-8ff1ecca74ae tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0510051 Dec 09 14:45:10.272553 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-91141fc1-58b7-46fb-972e-abbb8c23d566 req-4d151157-aa73-4075-9e34-c1f5b314c4a6 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429471 Dec 09 14:45:10.834096 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c77222-e6c0-4634-ac8e-c651cd88de92 req-bd10b2ba-3d8f-4c9f-b1b7-81d31f3a773d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:10.835592 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e6c77222-e6c0-4634-ac8e-c651cd88de92 req-bd10b2ba-3d8f-4c9f-b1b7-81d31f3a773d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 945 time: 0.0495615 Dec 09 14:45:10.884373 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2622f1a9-d127-4349-aab9-98b7c1265d48 req-39cfd5a6-d5fe-4165-beb4-97ac565411f8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:10.886118 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2622f1a9-d127-4349-aab9-98b7c1265d48 req-39cfd5a6-d5fe-4165-beb4-97ac565411f8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0488796 Dec 09 14:45:10.887488 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e6c77222-e6c0-4634-ac8e-c651cd88de92 req-ff3875f7-9b2b-41f2-9b0a-ea50f3cdea47 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453770 Dec 09 14:45:10.935617 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2622f1a9-d127-4349-aab9-98b7c1265d48 req-d07d1ef5-41d5-47c5-a579-037a24edfd57 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430787 Dec 09 14:45:11.001183 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eebc2628-2ef9-4004-af85-caf8acfc609d req-e7817ea5-b204-4f1a-9068-d0a1e416ea56 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:11.002594 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-eebc2628-2ef9-4004-af85-caf8acfc609d req-e7817ea5-b204-4f1a-9068-d0a1e416ea56 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0525036 Dec 09 14:45:11.049679 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-eebc2628-2ef9-4004-af85-caf8acfc609d req-0c8347bc-4598-4556-a7b0-bec2bcc15572 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410304 Dec 09 14:45:11.403469 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9aa6ef4-710a-4405-a51d-50a9c18a69a7 req-7c29aae0-41f2-4909-ba6a-cf260a310223 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:11.404970 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f9aa6ef4-710a-4405-a51d-50a9c18a69a7 req-7c29aae0-41f2-4909-ba6a-cf260a310223 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0588074 Dec 09 14:45:11.462064 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f9aa6ef4-710a-4405-a51d-50a9c18a69a7 req-3d530179-6751-4cd3-b825-355fd1625380 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479941 Dec 09 14:45:12.006326 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1664b443-ebd5-4692-9b3f-338e75b9329a req-69a287ac-d738-4f70-a46d-2d37749c9d51 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:12.007971 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1664b443-ebd5-4692-9b3f-338e75b9329a req-69a287ac-d738-4f70-a46d-2d37749c9d51 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 945 time: 0.0500870 Dec 09 14:45:12.053149 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed73ab92-77e4-4e47-a625-5c340ef26ec0 req-64417132-c3da-4c4e-b99a-bacbfb36829c tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:12.054735 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ed73ab92-77e4-4e47-a625-5c340ef26ec0 req-64417132-c3da-4c4e-b99a-bacbfb36829c tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0503993 Dec 09 14:45:12.056513 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1664b443-ebd5-4692-9b3f-338e75b9329a req-0272c7d4-576e-405f-89e6-450a77682335 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421562 Dec 09 14:45:12.108099 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ed73ab92-77e4-4e47-a625-5c340ef26ec0 req-1f1af475-2d25-42d5-aeca-58f893fbe691 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0468717 Dec 09 14:45:12.178330 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aabf1b27-9279-4ea8-b30d-c21d8629d652 req-16bc1ea0-c7d6-4369-989e-e377eafadbdd tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:12.179862 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-aabf1b27-9279-4ea8-b30d-c21d8629d652 req-16bc1ea0-c7d6-4369-989e-e377eafadbdd tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 946 time: 0.0552058 Dec 09 14:45:12.235873 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-aabf1b27-9279-4ea8-b30d-c21d8629d652 req-1dc931c3-5ecf-485e-952f-4a2741544227 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495226 Dec 09 14:45:12.579918 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d88fe4c-a9af-4fbf-951f-4a272e22879b req-e8d78d68-cde2-4fb5-82b6-fcb468a6f962 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:12.581558 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8d88fe4c-a9af-4fbf-951f-4a272e22879b req-e8d78d68-cde2-4fb5-82b6-fcb468a6f962 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0508032 Dec 09 14:45:12.631824 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8d88fe4c-a9af-4fbf-951f-4a272e22879b req-67b4842e-b320-48af-b224-53812a21ac20 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435252 Dec 09 14:45:13.055576 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:45:13.133902 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:13.161686 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:45:13.163955 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6aaad2d4-2e57-4cfb-b755-f46be8576f12" -d '{"events": [{"server_uuid": "a8ee2ec0-d1d7-458d-ae2a-509098efff13", "name": "network-vif-unplugged", "status": "completed", "tag": "eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:45:13.184336 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:45:13.189897 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:13.223422 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 09 Dec 2021 14:45:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c9386bf1-fd7c-423b-a2d1-21cef03322d3 x-openstack-request-id: req-c9386bf1-fd7c-423b-a2d1-21cef03322d3 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:45:13.223738 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a8ee2ec0-d1d7-458d-ae2a-509098efff13", "name": "network-vif-unplugged", "status": "failed", "tag": "eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7", "code": 422}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:45:13.223993 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-c9386bf1-fd7c-423b-a2d1-21cef03322d3 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:45:13.224399 dv-cinder-819692-8-iscsi neutron-server[109063]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'code': 422} returned with failed status Dec 09 14:45:13.236859 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22c0174a-16d3-4758-9736-6701fa9612f8 req-d8a2bd43-5bb5-40d8-bdff-4adbf91719f0 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:13.245521 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-22c0174a-16d3-4758-9736-6701fa9612f8 req-d8a2bd43-5bb5-40d8-bdff-4adbf91719f0 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0613179 Dec 09 14:45:13.257477 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,revision_number=8']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:13.301096 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-22c0174a-16d3-4758-9736-6701fa9612f8 req-f3a14ba4-ac0f-4e5f-9798-36312dad3051 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0535662 Dec 09 14:45:13.309573 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 56850) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:13.371169 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21a38752-2807-42b2-81e0-ca42b80563e4 req-479b2647-35e3-46ca-80ff-293d4b5fa59a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:13.372832 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-21a38752-2807-42b2-81e0-ca42b80563e4 req-479b2647-35e3-46ca-80ff-293d4b5fa59a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0540090 Dec 09 14:45:13.425057 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ab8a8276-a801-4eb1-a323-b91481180fed admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:13.432170 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-21a38752-2807-42b2-81e0-ca42b80563e4 req-53a73382-0f3b-4add-b672-771e592ec07d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0531917 Dec 09 14:45:13.511540 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ab8a8276-a801-4eb1-a323-b91481180fed admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:13.519669 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ab8a8276-a801-4eb1-a323-b91481180fed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:13.556554 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab8a8276-a801-4eb1-a323-b91481180fed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b6ab4a3-fd72-4688-99b9-533a253f7acb,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:13.560873 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-ab8a8276-a801-4eb1-a323-b91481180fed admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=db9ac3fc58434c498d7b189cee1ea168&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2502162 Dec 09 14:45:13.564141 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 56862) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:13.615275 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3cbe954e-d627-4c1d-a483-0cc1819fe0ab admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:13.637312 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3cbe954e-d627-4c1d-a483-0cc1819fe0ab admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:13.698765 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3cbe954e-d627-4c1d-a483-0cc1819fe0ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:13.701428 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3cbe954e-d627-4c1d-a483-0cc1819fe0ab admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:13.705079 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-3cbe954e-d627-4c1d-a483-0cc1819fe0ab admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/1b6ab4a3-fd72-4688-99b9-533a253f7acb HTTP/1.1" status: 204 len: 168 time: 0.1375282 Dec 09 14:45:13.711788 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cbe954e-d627-4c1d-a483-0cc1819fe0ab admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b6ab4a3-fd72-4688-99b9-533a253f7acb,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:13.791961 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0642706c-600d-4306-91c0-08a47e9bd69c req-2cd9ae67-03fe-4b91-b2c9-61fc823a170a tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:13.797595 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0642706c-600d-4306-91c0-08a47e9bd69c req-2cd9ae67-03fe-4b91-b2c9-61fc823a170a tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0649536 Dec 09 14:45:13.851862 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0642706c-600d-4306-91c0-08a47e9bd69c req-3713aeed-2f1f-4374-b8e5-5e3b7b70b8be tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515025 Dec 09 14:45:13.959319 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [req-8715c19c-929c-45e5-a4de-2f18be9d655a req-59e35029-b2a3-4684-85b9-2cf43fa4b290 service neutron] http://10.222.0.39:9696/v2.0/extensions returned with HTTP 200 {{(pid=109061) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 14:45:13.960321 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8715c19c-929c-45e5-a4de-2f18be9d655a req-59e35029-b2a3-4684-85b9-2cf43fa4b290 service neutron] 10.222.0.39 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0057459 Dec 09 14:45:14.016720 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 56880) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:14.032109 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e1bcbe80-023c-4a1c-8357-73cda90afdd1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:14.152276 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f4de285-ad0c-4466-959f-8622ee372256 req-1398faa3-b9e6-434b-8435-34c3553eda55 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:14.153899 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7f4de285-ad0c-4466-959f-8622ee372256 req-1398faa3-b9e6-434b-8435-34c3553eda55 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0808346 Dec 09 14:45:14.173089 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e1bcbe80-023c-4a1c-8357-73cda90afdd1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:14.184326 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e1bcbe80-023c-4a1c-8357-73cda90afdd1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:14.240360 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-e1bcbe80-023c-4a1c-8357-73cda90afdd1 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=c9c866a4efcd4fe6bd623a2889f0a3f0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2223225 Dec 09 14:45:14.242906 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 56894) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:14.245675 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1bcbe80-023c-4a1c-8357-73cda90afdd1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bc1b0c92-ca6e-4d38-afc3-3eed8ec944a7,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:14.253112 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7f4de285-ad0c-4466-959f-8622ee372256 req-009ccc1a-dc8e-4f45-9ef4-df716faadf4d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0893869 Dec 09 14:45:14.302899 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d3f3dcf6-250d-4388-8b3e-d7b8f35a2e7f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:14.325445 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d3f3dcf6-250d-4388-8b3e-d7b8f35a2e7f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:14.413373 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d3f3dcf6-250d-4388-8b3e-d7b8f35a2e7f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:14.416007 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d3f3dcf6-250d-4388-8b3e-d7b8f35a2e7f admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:14.417139 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-d3f3dcf6-250d-4388-8b3e-d7b8f35a2e7f admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/bc1b0c92-ca6e-4d38-afc3-3eed8ec944a7 HTTP/1.1" status: 204 len: 168 time: 0.1732419 Dec 09 14:45:14.430866 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3f3dcf6-250d-4388-8b3e-d7b8f35a2e7f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bc1b0c92-ca6e-4d38-afc3-3eed8ec944a7,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:14.443131 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e98190be-6a92-4940-921c-b91786f986cd req-59ca6193-3eb2-4833-89ee-4db6d6556b53 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:14.444821 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e98190be-6a92-4940-921c-b91786f986cd req-59ca6193-3eb2-4833-89ee-4db6d6556b53 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0681672 Dec 09 14:45:14.465404 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 56908) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:14.516188 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e98190be-6a92-4940-921c-b91786f986cd req-9d71bcf8-cf33-4398-9b30-543530adc11b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0652101 Dec 09 14:45:14.564828 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-120d6267-2249-4ae5-a99d-9954eb5ca780 service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0973094 Dec 09 14:45:14.573842 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-4181c857-2a05-46a0-ac10-ba4ee013ed61 service neutron] http://10.222.0.39:9696/v2.0/extensions returned with HTTP 200 {{(pid=109062) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 14:45:14.575012 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-4181c857-2a05-46a0-ac10-ba4ee013ed61 service neutron] 10.222.0.39 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0053220 Dec 09 14:45:14.770163 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:14.984284 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b376d33-ced4-4dc3-9799-12d437e8d1ee req-ce326e46-0594-4abf-a9c4-35a66c7d8c7b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:14.985961 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4b376d33-ced4-4dc3-9799-12d437e8d1ee req-ce326e46-0594-4abf-a9c4-35a66c7d8c7b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0564420 Dec 09 14:45:15.043676 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4b376d33-ced4-4dc3-9799-12d437e8d1ee req-2c1cdb2d-bd0f-4141-b122-0b3b11a0f46b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467017 Dec 09 14:45:15.390711 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a1ba58-dd62-4e90-95c7-6d4c919cadac req-a11cc1c4-f343-41a7-a872-17f753ab2ac2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:15.392338 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-45a1ba58-dd62-4e90-95c7-6d4c919cadac req-a11cc1c4-f343-41a7-a872-17f753ab2ac2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0497687 Dec 09 14:45:15.444646 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-45a1ba58-dd62-4e90-95c7-6d4c919cadac req-57fb24c2-042f-499d-89b8-5b97426d4f13 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461633 Dec 09 14:45:15.642116 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-780b8c41-adfc-4b37-a2f6-fc103a4b884e req-4dacb062-76b8-477b-a0ad-ddec0c0bd693 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:15.643483 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-780b8c41-adfc-4b37-a2f6-fc103a4b884e req-4dacb062-76b8-477b-a0ad-ddec0c0bd693 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0530691 Dec 09 14:45:15.693007 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-780b8c41-adfc-4b37-a2f6-fc103a4b884e req-48dfb94a-48de-4bb0-b737-b331035fb603 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422323 Dec 09 14:45:16.181445 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d49f3809-c07e-4362-9a91-2b60df21e02b req-4b37b901-7975-455a-9065-9a35e50d7586 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:16.183113 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d49f3809-c07e-4362-9a91-2b60df21e02b req-4b37b901-7975-455a-9065-9a35e50d7586 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0645959 Dec 09 14:45:16.235970 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d49f3809-c07e-4362-9a91-2b60df21e02b req-28397d20-9fd8-4227-917e-c9c1694dfc4f tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460105 Dec 09 14:45:16.349183 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-a3600446-ee9d-4ecd-84ee-06652d1a2f42 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:16.350598 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-a3600446-ee9d-4ecd-84ee-06652d1a2f42 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13&tenant_id=6be5d78d2d0049448c3947b4e650758a HTTP/1.1" status: 200 len: 1097 time: 0.0726662 Dec 09 14:45:16.415980 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-2aa5cf74-c36f-44b6-8b34-1bf86cd691d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:16.417522 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-2aa5cf74-c36f-44b6-8b34-1bf86cd691d2 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=6be5d78d2d0049448c3947b4e650758a&device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 1097 time: 0.0414102 Dec 09 14:45:16.514970 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-60061b7c-ab65-4d6f-b6f5-66eff32e6360 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:16.516510 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-60061b7c-ab65-4d6f-b6f5-66eff32e6360 service neutron] 10.222.0.44 "GET /v2.0/networks?id=9ab3f8b6-44d0-4210-907d-0e96072c4566 HTTP/1.1" status: 200 len: 917 time: 0.0904074 Dec 09 14:45:16.571815 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f1e6c57-7810-480a-a2d4-a971f7de8e16 req-3c1c0ad5-4026-4cb1-908f-c96838ef1b14 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:16.573354 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0f1e6c57-7810-480a-a2d4-a971f7de8e16 req-3c1c0ad5-4026-4cb1-908f-c96838ef1b14 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0520127 Dec 09 14:45:16.589889 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-39915ff2-52c0-4280-88ad-2e52939c2a77 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 HTTP/1.1" status: 200 len: 1000 time: 0.0624917 Dec 09 14:45:16.629470 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0f1e6c57-7810-480a-a2d4-a971f7de8e16 req-dd650446-cd5e-439d-99ad-3bdefa8d7b20 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495200 Dec 09 14:45:16.650639 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-6e7f6677-f3f3-4dfd-8a9c-f1e9a2ec7032 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:16.652143 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-6e7f6677-f3f3-4dfd-8a9c-f1e9a2ec7032 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=f10f1097-5d43-4737-bcac-a27ade66b442 HTTP/1.1" status: 200 len: 855 time: 0.0486031 Dec 09 14:45:16.699853 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-d8c628bc-be42-4c49-a653-4b7dce46df7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:16.701414 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-d8c628bc-be42-4c49-a653-4b7dce46df7f service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=9ab3f8b6-44d0-4210-907d-0e96072c4566&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0401068 Dec 09 14:45:16.825886 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-aabe5fd8-4d4e-4e90-85ba-e910e4c00a5e service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1157608 Dec 09 14:45:16.849695 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-189e47fc-80f6-416c-8b56-5185c3235a85 req-cccc4007-c2ca-49da-a37f-2b5456ced0cb tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:16.851214 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-189e47fc-80f6-416c-8b56-5185c3235a85 req-cccc4007-c2ca-49da-a37f-2b5456ced0cb tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0798359 Dec 09 14:45:16.948194 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-189e47fc-80f6-416c-8b56-5185c3235a85 req-e5ad9598-b463-4ff2-af2c-5d80ea8aecd0 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0854683 Dec 09 14:45:16.962105 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8fa555a3-4bd5-4230-bbec-a6fe07245724 req-1e104a6a-96bc-43e7-bb11-e2485a558b3d service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1266935 Dec 09 14:45:17.211226 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bda2e95f-7c28-4c37-a2ff-1e5384511d9a req-2c7e7ce2-6fe3-4e29-820c-138c780d1427 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:17.212886 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bda2e95f-7c28-4c37-a2ff-1e5384511d9a req-2c7e7ce2-6fe3-4e29-820c-138c780d1427 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0620053 Dec 09 14:45:17.306977 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bda2e95f-7c28-4c37-a2ff-1e5384511d9a req-91e262d6-c4a3-449b-acdb-de24e3c625be tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0852411 Dec 09 14:45:17.309346 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d37817b-0ba2-4387-8e51-5c67c3936409 req-4b4cd117-18d6-4af0-b9c2-51585e17c3b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:17.311465 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7d37817b-0ba2-4387-8e51-5c67c3936409 req-4b4cd117-18d6-4af0-b9c2-51585e17c3b0 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=a538bf01cb5440ffa06b6873f212efaa&device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 1098 time: 0.0811276 Dec 09 14:45:17.377635 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-67b8d833-15b6-4676-9cd3-4f4d1a6127e8 req-098bddc6-285c-462d-a68c-63422a1e58b8 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:17.388284 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-67b8d833-15b6-4676-9cd3-4f4d1a6127e8 req-098bddc6-285c-462d-a68c-63422a1e58b8 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0666342 Dec 09 14:45:17.436869 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:45:17.441735 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-67b8d833-15b6-4676-9cd3-4f4d1a6127e8 req-e6bfec19-a4fa-4b81-bf65-85b65e5554d0 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0506237 Dec 09 14:45:17.448046 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d37817b-0ba2-4387-8e51-5c67c3936409 req-3b6048d7-78e1-43ed-b85f-dd3195684d92 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:17.449835 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7d37817b-0ba2-4387-8e51-5c67c3936409 req-3b6048d7-78e1-43ed-b85f-dd3195684d92 service neutron] 10.222.0.44 "GET /v2.0/networks?id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b HTTP/1.1" status: 200 len: 911 time: 0.1293697 Dec 09 14:45:17.527943 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7d37817b-0ba2-4387-8e51-5c67c3936409 req-661164bd-a559-4030-8769-680e4283550f service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c5d8b8cc-2c67-46a7-867d-276136fccdf1 HTTP/1.1" status: 200 len: 1000 time: 0.0639513 Dec 09 14:45:17.583456 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d37817b-0ba2-4387-8e51-5c67c3936409 req-04f7bcd3-7bab-4147-b8f0-27cbdb8c3f9f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:17.585354 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7d37817b-0ba2-4387-8e51-5c67c3936409 req-04f7bcd3-7bab-4147-b8f0-27cbdb8c3f9f service neutron] 10.222.0.44 "GET /v2.0/subnets?id=4b7e026c-4454-4200-91c3-30d27a976452 HTTP/1.1" status: 200 len: 849 time: 0.0494211 Dec 09 14:45:17.795074 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7113772-2355-4893-9c59-8bf79982be59 req-dff39bff-64d3-49cc-8435-eb1c32d4adb9 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:17.797664 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c7113772-2355-4893-9c59-8bf79982be59 req-dff39bff-64d3-49cc-8435-eb1c32d4adb9 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0703475 Dec 09 14:45:17.860738 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c7113772-2355-4893-9c59-8bf79982be59 req-7fd57566-9466-4178-8ebf-e353f381449c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0577142 Dec 09 14:45:18.431986 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ccd087b-c920-44f1-823a-b57bf0579a8b req-231458b9-271a-4e6e-8d98-a07fa16c54fc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:18.433485 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2ccd087b-c920-44f1-823a-b57bf0579a8b req-231458b9-271a-4e6e-8d98-a07fa16c54fc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0536060 Dec 09 14:45:18.494730 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2ccd087b-c920-44f1-823a-b57bf0579a8b req-e62544b6-2c31-4436-a11d-3f41e384dbc7 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0548661 Dec 09 14:45:18.565850 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d660b69-367a-4bd5-8f9c-77e53e2ab7fa req-3b4f72cd-4d5b-4e90-8f31-51978c3bab34 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:18.567397 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4d660b69-367a-4bd5-8f9c-77e53e2ab7fa req-3b4f72cd-4d5b-4e90-8f31-51978c3bab34 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0508509 Dec 09 14:45:18.615881 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4d660b69-367a-4bd5-8f9c-77e53e2ab7fa req-3bdff546-d01c-4864-85b9-668507e2263a tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423040 Dec 09 14:45:18.986394 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66c487da-3aba-4a13-8a52-ccfef7f1eacb req-88f0265e-9a9e-4d8e-82e9-e22f393e4b05 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:18.987976 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-66c487da-3aba-4a13-8a52-ccfef7f1eacb req-88f0265e-9a9e-4d8e-82e9-e22f393e4b05 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0514686 Dec 09 14:45:19.069305 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-66c487da-3aba-4a13-8a52-ccfef7f1eacb req-a6cb7097-4bbd-48be-8ef4-89421d96f8da tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0752339 Dec 09 14:45:19.635700 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe400d8a-5ad2-44a1-95e8-c0c8553f1f02 req-937d6e42-3149-4289-b87e-b4e75e5013b5 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:19.637660 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fe400d8a-5ad2-44a1-95e8-c0c8553f1f02 req-937d6e42-3149-4289-b87e-b4e75e5013b5 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0611274 Dec 09 14:45:19.689509 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fe400d8a-5ad2-44a1-95e8-c0c8553f1f02 req-563f2015-0b56-41b6-a27d-28f36f65a44d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449231 Dec 09 14:45:19.736123 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07c824f9-6f6b-4d10-9c91-82265a9305a6 req-6cd12347-f853-4ff9-b73e-12725030eeb0 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:19.738717 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-07c824f9-6f6b-4d10-9c91-82265a9305a6 req-6cd12347-f853-4ff9-b73e-12725030eeb0 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0541561 Dec 09 14:45:19.796056 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-07c824f9-6f6b-4d10-9c91-82265a9305a6 req-fd61cab0-0d2c-4f6f-bd49-c8f5cc772afc tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492523 Dec 09 14:45:20.197366 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d26ea11-7506-4ad3-b111-56aa44e1c58a req-a704b07d-963b-4c77-8637-e719f5ad3b47 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:20.198858 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3d26ea11-7506-4ad3-b111-56aa44e1c58a req-a704b07d-963b-4c77-8637-e719f5ad3b47 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0502102 Dec 09 14:45:20.254066 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3d26ea11-7506-4ad3-b111-56aa44e1c58a req-3b292a46-25cd-423f-b53e-28280e8ea2c8 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490327 Dec 09 14:45:20.811174 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-457b5fba-a42e-492d-8fbe-9a63a5dc86ad req-8b57a184-b340-498e-aab3-8e1e5d21cbe8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:20.812753 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-457b5fba-a42e-492d-8fbe-9a63a5dc86ad req-8b57a184-b340-498e-aab3-8e1e5d21cbe8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0561447 Dec 09 14:45:20.862978 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-457b5fba-a42e-492d-8fbe-9a63a5dc86ad req-786e0a54-681b-47ec-bbc3-6b8cbdcd467f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440028 Dec 09 14:45:20.924229 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72fd48c9-dc00-45b0-bb31-2da908dd6563 req-f0206149-32e5-4f31-aa46-ae1baeb65f18 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:20.925746 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-72fd48c9-dc00-45b0-bb31-2da908dd6563 req-f0206149-32e5-4f31-aa46-ae1baeb65f18 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0531361 Dec 09 14:45:20.972153 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-72fd48c9-dc00-45b0-bb31-2da908dd6563 req-64c6a302-2d68-42e6-9440-1b150a8efeea tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404394 Dec 09 14:45:21.412349 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2904890f-3c89-446a-8649-77baf1850c85 req-1192f281-16cd-4789-8117-9a96d1147e2f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:21.413758 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2904890f-3c89-446a-8649-77baf1850c85 req-1192f281-16cd-4789-8117-9a96d1147e2f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0572753 Dec 09 14:45:21.467344 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2904890f-3c89-446a-8649-77baf1850c85 req-5d33c6b1-9bc0-4b8f-827e-09aa57864f32 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472355 Dec 09 14:45:22.011788 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f6e32d3-7a84-4085-a95b-71ccf2fe5381 req-90e4925d-a9c2-40d1-b722-008784f9f642 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:22.013304 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9f6e32d3-7a84-4085-a95b-71ccf2fe5381 req-90e4925d-a9c2-40d1-b722-008784f9f642 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0566354 Dec 09 14:45:22.066228 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9f6e32d3-7a84-4085-a95b-71ccf2fe5381 req-62984497-60cb-4c72-bfbd-e7889f28085c tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0468457 Dec 09 14:45:22.111191 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5188c3a6-0c02-4f09-94c4-adf732f98b3c req-d4d06eb7-4156-464a-85ec-2fca074e9839 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:22.112729 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5188c3a6-0c02-4f09-94c4-adf732f98b3c req-d4d06eb7-4156-464a-85ec-2fca074e9839 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0647101 Dec 09 14:45:22.165145 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5188c3a6-0c02-4f09-94c4-adf732f98b3c req-0dcf2274-cb17-4be2-b90d-ca546917b0c6 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464103 Dec 09 14:45:22.591888 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a78313c-ae41-4059-bdc8-3890889946e3 req-69714772-6b3e-4e96-bbb6-c6d28ebc24fc tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:22.593561 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8a78313c-ae41-4059-bdc8-3890889946e3 req-69714772-6b3e-4e96-bbb6-c6d28ebc24fc tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0523295 Dec 09 14:45:22.645520 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8a78313c-ae41-4059-bdc8-3890889946e3 req-c884b99a-65ab-4401-9dca-0c29e947418a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458267 Dec 09 14:45:23.192851 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-914ba97e-301a-4fd3-9803-9d1b5b2b76aa req-4aa2cc55-b78d-45c0-a6e8-f6f48d5ea6b5 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:23.194369 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-914ba97e-301a-4fd3-9803-9d1b5b2b76aa req-4aa2cc55-b78d-45c0-a6e8-f6f48d5ea6b5 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0556378 Dec 09 14:45:23.243832 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-914ba97e-301a-4fd3-9803-9d1b5b2b76aa req-81f71f4d-7e37-4d96-ab3e-c3f71a77bf91 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433376 Dec 09 14:45:23.292182 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3706f0a-6413-40a3-ba4c-2ccd92416052 req-223e9653-8da0-4160-9605-99f3a2d105a0 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:23.293828 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e3706f0a-6413-40a3-ba4c-2ccd92416052 req-223e9653-8da0-4160-9605-99f3a2d105a0 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0548282 Dec 09 14:45:23.342616 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e3706f0a-6413-40a3-ba4c-2ccd92416052 req-34aac590-8d15-48df-9a2f-38d3c0ca12a6 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425661 Dec 09 14:45:23.769723 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6f6221d-2dbc-4209-b5b7-a365f26b4540 req-53a80b15-f3a2-4225-bd55-30f186fa725b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:23.771204 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a6f6221d-2dbc-4209-b5b7-a365f26b4540 req-53a80b15-f3a2-4225-bd55-30f186fa725b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0523171 Dec 09 14:45:23.826467 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a6f6221d-2dbc-4209-b5b7-a365f26b4540 req-bfc8bc3a-137f-443b-96d2-f83726de90fc tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0491910 Dec 09 14:45:24.361316 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50c76d47-df8e-46ef-a2ac-c253abf2933b req-128688ac-99ee-482a-8003-7fe69caf5b00 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:24.362831 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-50c76d47-df8e-46ef-a2ac-c253abf2933b req-128688ac-99ee-482a-8003-7fe69caf5b00 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0506902 Dec 09 14:45:24.416550 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-50c76d47-df8e-46ef-a2ac-c253abf2933b req-997dc9ac-dca0-478c-a356-37b837e7a62b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0474560 Dec 09 14:45:24.468691 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bebcae7d-8cf9-4fed-9551-8a3fdf2186a6 req-f75bb946-b467-456e-92d4-5a067efd6676 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:24.470423 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-bebcae7d-8cf9-4fed-9551-8a3fdf2186a6 req-f75bb946-b467-456e-92d4-5a067efd6676 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0548496 Dec 09 14:45:24.522379 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-bebcae7d-8cf9-4fed-9551-8a3fdf2186a6 req-e6f7b497-59ee-4314-bf9c-9fcb72169158 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0449514 Dec 09 14:45:24.953069 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-327565d1-de96-4054-a3d9-db226aea79bb req-94b75141-50b9-496c-b148-1b5a7ed45324 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:24.954521 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-327565d1-de96-4054-a3d9-db226aea79bb req-94b75141-50b9-496c-b148-1b5a7ed45324 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0474422 Dec 09 14:45:25.027100 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-327565d1-de96-4054-a3d9-db226aea79bb req-cb00810d-a4c7-438d-90c8-33f5b597dd4a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0660179 Dec 09 14:45:25.548873 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f4e2d38-94a9-4dff-9029-a4e108acdfe7 req-583b4fab-b7c5-4ab9-8105-a6975bd155f4 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:25.550354 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4f4e2d38-94a9-4dff-9029-a4e108acdfe7 req-583b4fab-b7c5-4ab9-8105-a6975bd155f4 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0541010 Dec 09 14:45:25.602769 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4f4e2d38-94a9-4dff-9029-a4e108acdfe7 req-c0fb0410-e9aa-40ae-a5eb-d1d969acdb09 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455463 Dec 09 14:45:25.648433 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee402b0b-b8cb-4a14-aaf5-23e266ccbdf3 req-a3365683-8839-41dd-8b53-5e74c3151e76 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:25.649995 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ee402b0b-b8cb-4a14-aaf5-23e266ccbdf3 req-a3365683-8839-41dd-8b53-5e74c3151e76 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0526059 Dec 09 14:45:25.700844 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ee402b0b-b8cb-4a14-aaf5-23e266ccbdf3 req-9655da69-1df5-4953-88f8-11496491c058 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447130 Dec 09 14:45:26.144726 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f53e3b-2d9e-4a26-9f63-43856ecaa475 req-6e14ed48-4703-474a-8b44-53a897f7dc24 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:26.146380 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-05f53e3b-2d9e-4a26-9f63-43856ecaa475 req-6e14ed48-4703-474a-8b44-53a897f7dc24 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0488770 Dec 09 14:45:26.204225 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-05f53e3b-2d9e-4a26-9f63-43856ecaa475 req-876ae3e6-35fa-48be-95ec-2df4e2ae8f5a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0514369 Dec 09 14:45:26.755957 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92f631cb-73b6-4ab8-bec6-43abc746eb64 req-6f9b2c32-6880-49cb-a8e5-cc591da85745 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:26.757460 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-92f631cb-73b6-4ab8-bec6-43abc746eb64 req-6f9b2c32-6880-49cb-a8e5-cc591da85745 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0674205 Dec 09 14:45:26.819171 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-92f631cb-73b6-4ab8-bec6-43abc746eb64 req-cc6b1c87-406e-4690-a637-ec3bd9e3ef93 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0554473 Dec 09 14:45:26.830012 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e30b76db-b336-442d-b2c9-17f9d87e0d8b req-ff41a5e1-5f40-461d-bbee-2d9992ff9ad6 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:26.832594 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e30b76db-b336-442d-b2c9-17f9d87e0d8b req-ff41a5e1-5f40-461d-bbee-2d9992ff9ad6 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0607319 Dec 09 14:45:26.883950 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e30b76db-b336-442d-b2c9-17f9d87e0d8b req-4225b566-db8a-4814-ae58-a8b35361dca4 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459883 Dec 09 14:45:27.004135 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-d95588c0-a58b-4ae7-a8d5-be7fae543474 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:27.329403 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24bb7290-bf24-4d6e-a19c-038c4dcfa289 req-bc4df8ea-bba1-4a07-8fdd-c201a8e3d022 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:27.330987 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-24bb7290-bf24-4d6e-a19c-038c4dcfa289 req-bc4df8ea-bba1-4a07-8fdd-c201a8e3d022 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0539851 Dec 09 14:45:27.383894 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-24bb7290-bf24-4d6e-a19c-038c4dcfa289 req-1ebfeb25-3bb7-46dc-8f46-b7bf34cbe074 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464449 Dec 09 14:45:27.961912 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f44a9e7-70da-426b-8f92-72f8786ef62e req-298e7a18-d5ca-4b0b-bbf4-6af7d33d6ee7 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:27.963926 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4f44a9e7-70da-426b-8f92-72f8786ef62e req-298e7a18-d5ca-4b0b-bbf4-6af7d33d6ee7 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0743704 Dec 09 14:45:28.013101 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2a1f3a0-d1bd-45d6-a481-b7ff80e4554e req-18ffab9c-cbdd-4b28-96f2-09df4fe7f6a5 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:28.014626 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c2a1f3a0-d1bd-45d6-a481-b7ff80e4554e req-18ffab9c-cbdd-4b28-96f2-09df4fe7f6a5 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0584505 Dec 09 14:45:28.015393 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4f44a9e7-70da-426b-8f92-72f8786ef62e req-f14e10ba-bc74-45e7-b401-ac514b18b10e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453296 Dec 09 14:45:28.067192 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c2a1f3a0-d1bd-45d6-a481-b7ff80e4554e req-1d24b1cb-d605-4fee-bc98-30a43d091d37 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451753 Dec 09 14:45:28.512296 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fed0919-c061-450a-a6de-4e954890bbf8 req-10bcafc8-77de-49de-b62c-4eb3c705dd1c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:28.514100 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7fed0919-c061-450a-a6de-4e954890bbf8 req-10bcafc8-77de-49de-b62c-4eb3c705dd1c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0524614 Dec 09 14:45:28.563978 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7fed0919-c061-450a-a6de-4e954890bbf8 req-1379287e-380c-4412-b27e-e95edcfa6d93 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434434 Dec 09 14:45:29.133930 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3e30d2b-d3b1-44a5-bd84-f652ddecb223 req-590e4212-fc47-4814-bf33-68f0194ce1e8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:29.135465 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f3e30d2b-d3b1-44a5-bd84-f652ddecb223 req-590e4212-fc47-4814-bf33-68f0194ce1e8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0502617 Dec 09 14:45:29.191777 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-42a989b4-2c72-4224-a95a-da754383c93a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:29.195496 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f3e30d2b-d3b1-44a5-bd84-f652ddecb223 req-2fb79eca-951f-4511-b7c4-6ff7d619ccc8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0507605 Dec 09 14:45:29.215660 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87d9365f-fd60-44ca-a30e-54f6c810e29a req-e29dbcad-7fcd-496d-8305-57f549e2851d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:29.221792 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-87d9365f-fd60-44ca-a30e-54f6c810e29a req-e29dbcad-7fcd-496d-8305-57f549e2851d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0759778 Dec 09 14:45:29.280437 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-87d9365f-fd60-44ca-a30e-54f6c810e29a req-e4767048-6da1-43f2-93a5-1cc912da8cf1 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0556698 Dec 09 14:45:29.693962 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a579b8a-790a-4326-ba39-c2675eb1bda0 req-2e27bb60-9c8a-4f57-be39-291f501129dc tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:29.695494 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5a579b8a-790a-4326-ba39-c2675eb1bda0 req-2e27bb60-9c8a-4f57-be39-291f501129dc tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0495822 Dec 09 14:45:29.743654 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5a579b8a-790a-4326-ba39-c2675eb1bda0 req-712f60c0-2c8b-440a-bcb6-63c2d31eb035 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419617 Dec 09 14:45:30.331113 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-313ea239-c2f8-446e-8ee2-6fda420c407d req-9f9fc5a7-385a-4929-a6ce-44bb096c0657 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:30.332909 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-313ea239-c2f8-446e-8ee2-6fda420c407d req-9f9fc5a7-385a-4929-a6ce-44bb096c0657 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0649967 Dec 09 14:45:30.392146 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-313ea239-c2f8-446e-8ee2-6fda420c407d req-06455440-d389-4eb6-887b-f4d3bc056d0e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0530968 Dec 09 14:45:30.415294 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:30.421690 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b5cdc7b-fb17-40e7-b097-f8f90d3b4b2f req-99556685-76de-4158-b3cb-b6f4b392c346 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:30.423210 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1b5cdc7b-fb17-40e7-b097-f8f90d3b4b2f req-99556685-76de-4158-b3cb-b6f4b392c346 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0665970 Dec 09 14:45:30.470952 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1b5cdc7b-fb17-40e7-b097-f8f90d3b4b2f req-960843bd-aa6a-4a51-a21d-8613b1e96b4a tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411665 Dec 09 14:45:30.476170 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 57178) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:30.587811 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2c56616e-8439-4e6b-b79a-d1f10e5aaa1b admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:30.659959 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2c56616e-8439-4e6b-b79a-d1f10e5aaa1b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:30.665381 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2c56616e-8439-4e6b-b79a-d1f10e5aaa1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:30.701745 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-2c56616e-8439-4e6b-b79a-d1f10e5aaa1b admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=58c78d9e206249ad9d4fb5537efd8d79&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2245181 Dec 09 14:45:30.702921 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2c56616e-8439-4e6b-b79a-d1f10e5aaa1b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb200ce2-4487-4d84-b260-bf5b8f3e0ced,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:30.704745 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 57182) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:30.782122 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-02f8c022-2828-4c0c-be96-dc9b63dca55b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:30.808144 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d37817b-0ba2-4387-8e51-5c67c3936409 req-0fb9d87b-56fe-4622-aebb-1dab3c052c4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:30.809637 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7d37817b-0ba2-4387-8e51-5c67c3936409 req-0fb9d87b-56fe-4622-aebb-1dab3c052c4a service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0685482 Dec 09 14:45:30.811406 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-02f8c022-2828-4c0c-be96-dc9b63dca55b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:30.893617 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-067a83e5-5cb3-4258-b236-f515fc1699c3 req-11a6398a-e464-4b81-8ca0-7f007b5fd32d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:30.895982 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-067a83e5-5cb3-4258-b236-f515fc1699c3 req-11a6398a-e464-4b81-8ca0-7f007b5fd32d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0503430 Dec 09 14:45:30.927563 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-02f8c022-2828-4c0c-be96-dc9b63dca55b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:30.930071 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-02f8c022-2828-4c0c-be96-dc9b63dca55b admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:30.933850 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-02f8c022-2828-4c0c-be96-dc9b63dca55b admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/fb200ce2-4487-4d84-b260-bf5b8f3e0ced HTTP/1.1" status: 204 len: 168 time: 0.2255111 Dec 09 14:45:30.941755 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7d37817b-0ba2-4387-8e51-5c67c3936409 req-bc25da35-19ff-4d6a-a544-b5bce24e38a2 service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1218338 Dec 09 14:45:30.943056 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02f8c022-2828-4c0c-be96-dc9b63dca55b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb200ce2-4487-4d84-b260-bf5b8f3e0ced,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:30.955272 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-067a83e5-5cb3-4258-b236-f515fc1699c3 req-d822a6df-91ea-4fd2-b1f9-64099412c6a6 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0528896 Dec 09 14:45:31.065983 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7d37817b-0ba2-4387-8e51-5c67c3936409 req-c74fd89b-dd0a-4e94-8fc5-cab2a0eebdd5 service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0911624 Dec 09 14:45:31.221586 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 57194) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:31.235253 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-556e06c5-a0cd-4435-9064-a1adafe4e9f5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:31.313304 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-556e06c5-a0cd-4435-9064-a1adafe4e9f5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:31.318645 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-556e06c5-a0cd-4435-9064-a1adafe4e9f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:31.355035 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-556e06c5-a0cd-4435-9064-a1adafe4e9f5 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=66af0e3e9bec4c7c913de379b9809656&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1322579 Dec 09 14:45:31.355868 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-556e06c5-a0cd-4435-9064-a1adafe4e9f5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=78e40546-6548-475b-a11a-910fccba9ea7,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:31.357993 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 57198) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:31.408590 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b98d404f-0e55-42da-a97b-ef2e0714673a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:31.433178 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b98d404f-0e55-42da-a97b-ef2e0714673a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:31.507185 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b98d404f-0e55-42da-a97b-ef2e0714673a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:31.509995 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b98d404f-0e55-42da-a97b-ef2e0714673a admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:31.511013 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-b98d404f-0e55-42da-a97b-ef2e0714673a admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/78e40546-6548-475b-a11a-910fccba9ea7 HTTP/1.1" status: 204 len: 168 time: 0.1519461 Dec 09 14:45:31.518690 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cb32c5a-1ca5-4088-963e-473f1297d6d0 req-f116674e-c754-4837-830c-787c1ab61a9f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:31.520169 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6cb32c5a-1ca5-4088-963e-473f1297d6d0 req-f116674e-c754-4837-830c-787c1ab61a9f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0579352 Dec 09 14:45:31.528087 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b98d404f-0e55-42da-a97b-ef2e0714673a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=78e40546-6548-475b-a11a-910fccba9ea7,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:31.584099 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6cb32c5a-1ca5-4088-963e-473f1297d6d0 req-f209c57f-e795-4e25-b51b-112703d75ac8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0534143 Dec 09 14:45:31.606941 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ed50521-a08b-453a-a902-c29d64f10706 req-15784438-e171-437f-adb6-e4d0b26fcc5d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:31.606941 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1ed50521-a08b-453a-a902-c29d64f10706 req-15784438-e171-437f-adb6-e4d0b26fcc5d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0494566 Dec 09 14:45:31.649954 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1ed50521-a08b-453a-a902-c29d64f10706 req-cb90e3a3-7f60-4a39-bf30-1134637c8ac6 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407841 Dec 09 14:45:31.795318 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:32.085448 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-685f0f0c-a755-468f-bf56-85573b9342be req-2360a9a7-be3b-4ba5-a5f4-cc517093d3d9 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:32.086964 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-685f0f0c-a755-468f-bf56-85573b9342be req-2360a9a7-be3b-4ba5-a5f4-cc517093d3d9 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0507338 Dec 09 14:45:32.136781 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-685f0f0c-a755-468f-bf56-85573b9342be req-bf25f27a-df9a-4edb-b6d7-03358f8c9a68 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429449 Dec 09 14:45:32.497793 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec5fbef-946d-48ee-9e8e-ff22217094cc req-4553d6af-42f6-4aaf-9936-7671548b1ddb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:32.499346 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4ec5fbef-946d-48ee-9e8e-ff22217094cc req-4553d6af-42f6-4aaf-9936-7671548b1ddb service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 1098 time: 0.0454378 Dec 09 14:45:32.548427 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4ec5fbef-946d-48ee-9e8e-ff22217094cc req-88fa5631-d69b-401d-ab23-011f8b9359f9 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0365093 Dec 09 14:45:32.622848 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:32.714964 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cce91615-b5b1-4c4b-9cea-faa58d3221a9 req-f9ec4cfb-07a3-41ab-9e29-4229e149856d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:32.719238 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-cce91615-b5b1-4c4b-9cea-faa58d3221a9 req-f9ec4cfb-07a3-41ab-9e29-4229e149856d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0620494 Dec 09 14:45:32.769014 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b42e62d-6c3a-460e-aecf-67af815881c0 req-3c02f8b1-b358-4cae-ade2-b96897b31727 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:32.770698 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0b42e62d-6c3a-460e-aecf-67af815881c0 req-3c02f8b1-b358-4cae-ade2-b96897b31727 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0529947 Dec 09 14:45:32.776317 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-cce91615-b5b1-4c4b-9cea-faa58d3221a9 req-a127f3f6-dac1-4bd6-ad10-97f94536c8df tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0480733 Dec 09 14:45:32.823419 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0b42e62d-6c3a-460e-aecf-67af815881c0 req-7cf14e5a-f1df-465f-a1f5-dfd3290e7fff tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421448 Dec 09 14:45:33.266538 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-957d2ac8-48de-4147-953e-f3f8ba0b2fc3 req-b16086ea-b1eb-43a9-9045-cc58ae66994d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:33.268120 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-957d2ac8-48de-4147-953e-f3f8ba0b2fc3 req-b16086ea-b1eb-43a9-9045-cc58ae66994d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0501535 Dec 09 14:45:33.314788 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-957d2ac8-48de-4147-953e-f3f8ba0b2fc3 req-cdf56e8f-6583-4e64-8a56-85ee363633ba tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402799 Dec 09 14:45:33.945379 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2ee08bd-b387-4504-a310-cc3f738aafda req-e1d7a127-4d9f-438b-92dc-ece7306fc623 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:33.946963 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b2ee08bd-b387-4504-a310-cc3f738aafda req-e1d7a127-4d9f-438b-92dc-ece7306fc623 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0534866 Dec 09 14:45:34.002607 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b2ee08bd-b387-4504-a310-cc3f738aafda req-5dd4f77e-a85e-4cdd-97e3-71fac9da7c09 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489359 Dec 09 14:45:34.439338 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe62d8a8-8320-480e-8ab1-99ccfd82c905 req-12fae490-3811-49b5-b16f-3ed5ffb2c749 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:34.441278 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fe62d8a8-8320-480e-8ab1-99ccfd82c905 req-12fae490-3811-49b5-b16f-3ed5ffb2c749 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0508807 Dec 09 14:45:34.489564 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fe62d8a8-8320-480e-8ab1-99ccfd82c905 req-4942c1ac-013c-4007-b6b2-b60740111b26 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426168 Dec 09 14:45:35.121191 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63fd5308-83aa-4610-b45d-4b7ad5afcabf req-619b9605-98bd-42e2-bb09-a4be460cdcd0 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:35.122684 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-63fd5308-83aa-4610-b45d-4b7ad5afcabf req-619b9605-98bd-42e2-bb09-a4be460cdcd0 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0502319 Dec 09 14:45:35.169870 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-63fd5308-83aa-4610-b45d-4b7ad5afcabf req-3a8855a8-9f59-451b-bd8a-58f366e88aff tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407531 Dec 09 14:45:35.467323 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199015e8-7a0e-4cc4-840d-18bc4654b7b0 req-5dcd082d-a236-41e3-a23e-e0564823ff02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:35.468918 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-199015e8-7a0e-4cc4-840d-18bc4654b7b0 req-5dcd082d-a236-41e3-a23e-e0564823ff02 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=3d298e3ebec54c2281ddf8bbb50b7cea&device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 1098 time: 0.0420260 Dec 09 14:45:35.476493 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05f6100-8c79-4603-ae0d-8edacf6713b7 req-61ea40da-138e-4444-8443-945da33596ce tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:35.477917 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b05f6100-8c79-4603-ae0d-8edacf6713b7 req-61ea40da-138e-4444-8443-945da33596ce tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0509710 Dec 09 14:45:35.524933 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b05f6100-8c79-4603-ae0d-8edacf6713b7 req-35d3c6bc-ab96-4238-b9f9-137a6cbd7a59 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409491 Dec 09 14:45:35.582816 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199015e8-7a0e-4cc4-840d-18bc4654b7b0 req-5ebdd2c0-7de6-470d-8c74-42440330f174 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:35.584317 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-199015e8-7a0e-4cc4-840d-18bc4654b7b0 req-5ebdd2c0-7de6-470d-8c74-42440330f174 service neutron] 10.222.0.44 "GET /v2.0/networks?id=8ff38a1e-5122-4806-8b7d-d4c281cbe550 HTTP/1.1" status: 200 len: 919 time: 0.1056385 Dec 09 14:45:35.641286 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-199015e8-7a0e-4cc4-840d-18bc4654b7b0 req-f96698a1-2020-4c82-b2c5-fe6b8e0aafe0 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=bb290a6d-709a-49d1-bd2e-10c0fe664657 HTTP/1.1" status: 200 len: 217 time: 0.0404832 Dec 09 14:45:35.656185 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35deda7e-2f9e-4828-a925-3a03e8598207 req-f68630db-8480-447a-a520-c90578628451 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:35.657655 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-35deda7e-2f9e-4828-a925-3a03e8598207 req-f68630db-8480-447a-a520-c90578628451 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0873103 Dec 09 14:45:35.964505 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-199015e8-7a0e-4cc4-840d-18bc4654b7b0 req-bf7be700-ad3f-4cc9-8b78-6c1e152eddfd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:35.965979 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-199015e8-7a0e-4cc4-840d-18bc4654b7b0 req-bf7be700-ad3f-4cc9-8b78-6c1e152eddfd service neutron] 10.222.0.44 "GET /v2.0/subnets?id=90388423-2d07-4cbe-80d8-fa2f6a3c14f7 HTTP/1.1" status: 200 len: 858 time: 0.3074901 Dec 09 14:45:35.977204 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-35deda7e-2f9e-4828-a925-3a03e8598207 req-c4d51d25-4b0e-4c3f-a880-53bea043b9dc tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3113806 Dec 09 14:45:36.003086 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-199015e8-7a0e-4cc4-840d-18bc4654b7b0 req-a0a7b054-52bf-4c20-8c81-87ff3c684e7f service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=8ff38a1e-5122-4806-8b7d-d4c281cbe550&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0248959 Dec 09 14:45:36.100649 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-199015e8-7a0e-4cc4-840d-18bc4654b7b0 req-c128e361-def7-414b-8afa-1ff51b6a08c3 service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838747 Dec 09 14:45:36.198163 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-199015e8-7a0e-4cc4-840d-18bc4654b7b0 req-158fee8c-b2b5-452b-8d86-c20c892490aa service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882897 Dec 09 14:45:36.633864 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 57362) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:36.651038 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e080c099-16c0-413b-8427-822b244414a9 req-59f37154-6a9b-4e20-a872-67f3345df7eb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:36.652563 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e080c099-16c0-413b-8427-822b244414a9 req-59f37154-6a9b-4e20-a872-67f3345df7eb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0542536 Dec 09 14:45:36.702625 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e080c099-16c0-413b-8427-822b244414a9 req-803b3dd2-7294-46a0-b190-35beaa574283 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433073 Dec 09 14:45:36.783188 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f9ed0e24-9c72-47b4-af97-3337a558a5a5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:36.863464 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f9ed0e24-9c72-47b4-af97-3337a558a5a5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:36.868167 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f9ed0e24-9c72-47b4-af97-3337a558a5a5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:36.907816 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-f9ed0e24-9c72-47b4-af97-3337a558a5a5 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=4567046a2ee04c29bc7e16f0173e3131&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2728841 Dec 09 14:45:36.909114 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9ed0e24-9c72-47b4-af97-3337a558a5a5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=65f176cc-dca7-4b24-ad75-f2072c6ed807,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:36.910685 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 57366) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:36.962828 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5048c8a2-6278-4445-b6c0-014b96e229e8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:36.988032 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5048c8a2-6278-4445-b6c0-014b96e229e8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:37.036886 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5048c8a2-6278-4445-b6c0-014b96e229e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:37.039515 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5048c8a2-6278-4445-b6c0-014b96e229e8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:37.040703 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-5048c8a2-6278-4445-b6c0-014b96e229e8 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/65f176cc-dca7-4b24-ad75-f2072c6ed807 HTTP/1.1" status: 204 len: 168 time: 0.1289036 Dec 09 14:45:37.048646 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5048c8a2-6278-4445-b6c0-014b96e229e8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=65f176cc-dca7-4b24-ad75-f2072c6ed807,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:37.105364 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5a81a4b-9855-4213-aa50-d6944ab3ee49 req-b9f020a5-e559-48b9-b757-ca32a6a81bc2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:37.107014 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f5a81a4b-9855-4213-aa50-d6944ab3ee49 req-b9f020a5-e559-48b9-b757-ca32a6a81bc2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0524263 Dec 09 14:45:37.156948 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f5a81a4b-9855-4213-aa50-d6944ab3ee49 req-dff07666-aa84-49ae-8ebd-99683ea94e72 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429370 Dec 09 14:45:37.318110 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 57376) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:37.331829 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-15e76dd4-94e4-46dd-9006-c2facdfac3c7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:37.409471 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-15e76dd4-94e4-46dd-9006-c2facdfac3c7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:37.415237 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-15e76dd4-94e4-46dd-9006-c2facdfac3c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:37.456236 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-15e76dd4-94e4-46dd-9006-c2facdfac3c7 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=7c201aaf48c44089b87e446c23e299d6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1369231 Dec 09 14:45:37.457119 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15e76dd4-94e4-46dd-9006-c2facdfac3c7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b1c25b9-44d9-41e6-ae98-02e86b7d8d1c,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:37.460051 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 57378) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:37.510559 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1d55bb85-4939-4b7a-8075-d61159d84743 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:37.530933 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1d55bb85-4939-4b7a-8075-d61159d84743 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:37.580136 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1d55bb85-4939-4b7a-8075-d61159d84743 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:37.582870 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-1d55bb85-4939-4b7a-8075-d61159d84743 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:37.584020 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-1d55bb85-4939-4b7a-8075-d61159d84743 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/8b1c25b9-44d9-41e6-ae98-02e86b7d8d1c HTTP/1.1" status: 204 len: 168 time: 0.1225820 Dec 09 14:45:37.591914 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d55bb85-4939-4b7a-8075-d61159d84743 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b1c25b9-44d9-41e6-ae98-02e86b7d8d1c,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:37.819402 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76af3ca1-8aad-4158-be82-a81eb61584d3 req-e7e508e2-1695-4dcf-a7f7-352cb7a6c2bc tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:37.820925 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-76af3ca1-8aad-4158-be82-a81eb61584d3 req-e7e508e2-1695-4dcf-a7f7-352cb7a6c2bc tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0486102 Dec 09 14:45:37.869648 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-76af3ca1-8aad-4158-be82-a81eb61584d3 req-900211ea-fa4c-4f12-97dc-aa286881e865 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424612 Dec 09 14:45:38.282039 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f94955e-9a77-421b-97af-7cf1dff8cae1 req-88c61459-f997-44b2-aa53-054a8b851ef8 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:38.283696 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2f94955e-9a77-421b-97af-7cf1dff8cae1 req-88c61459-f997-44b2-aa53-054a8b851ef8 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 944 time: 0.0501521 Dec 09 14:45:38.337522 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2f94955e-9a77-421b-97af-7cf1dff8cae1 req-cd6d2ecd-2d21-4247-b57b-14e26b8e1a0c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475237 Dec 09 14:45:39.168069 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:45:39.213260 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-383636ae-42af-4913-bbdc-4adf14ad47a5 req-ef059ed3-9e63-40a7-a02a-0f0a66712e0e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:39.214955 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-383636ae-42af-4913-bbdc-4adf14ad47a5 req-ef059ed3-9e63-40a7-a02a-0f0a66712e0e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.2782087 Dec 09 14:45:39.262750 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-383636ae-42af-4913-bbdc-4adf14ad47a5 req-cc3c1f7a-b7b3-4cfd-bb24-f19433305d73 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411365 Dec 09 14:45:39.280887 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:45:39.292931 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'port_id': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'mac_address': 'fa:16:3e:50:6b:8c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 412, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:45:39.333184 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:39.353403 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:45:39.376757 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:45:39.381893 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:39.439355 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,revision_number=9']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:39.487360 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8786fa3f-6922-4be6-acd5-17818e30e4d6 req-6d72ea92-d040-4bbc-8d06-91fbb985aa1d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:39.488890 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8786fa3f-6922-4be6-acd5-17818e30e4d6 req-6d72ea92-d040-4bbc-8d06-91fbb985aa1d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 945 time: 0.0615599 Dec 09 14:45:39.543106 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8786fa3f-6922-4be6-acd5-17818e30e4d6 req-0a96f91d-ad89-42c4-a8a5-a098626d3b83 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465415 Dec 09 14:45:39.711929 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:45:40.668281 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46ded894-e162-42a6-80d1-50c9fa94da0c req-ac5c92bc-60a2-492b-9de7-692b9923e39f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:40.669753 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-46ded894-e162-42a6-80d1-50c9fa94da0c req-ac5c92bc-60a2-492b-9de7-692b9923e39f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 945 time: 0.0483315 Dec 09 14:45:40.719222 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-46ded894-e162-42a6-80d1-50c9fa94da0c req-dbab7b91-2b93-4e23-8087-44e1f07bb0f7 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434504 Dec 09 14:45:41.181335 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:45:41.230918 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:41.231294 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:41.315490 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:41.343662 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:45:41.345955 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9de1dcd7-8621-4faf-bc0c-df726d7d776f" -d '{"events": [{"server_uuid": "a8ee2ec0-d1d7-458d-ae2a-509098efff13", "name": "network-vif-plugged", "status": "completed", "tag": "eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:45:41.358981 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:45:41.364279 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:41.388366 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:45:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-405269f4-4c84-4916-a056-d76f790e65e4 x-openstack-request-id: req-405269f4-4c84-4916-a056-d76f790e65e4 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:45:41.388685 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a8ee2ec0-d1d7-458d-ae2a-509098efff13", "name": "network-vif-plugged", "status": "completed", "tag": "eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:45:41.388945 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-405269f4-4c84-4916-a056-d76f790e65e4 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:45:41.389334 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'code': 200} Dec 09 14:45:41.415919 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,revision_number=10']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:41.652104 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 57470) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:41.760025 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:41.882180 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a238652-7867-4c1d-9dec-dbb1c46a099a req-b47e5147-fc3a-4164-b266-99a13c21c8c8 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:41.883666 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1a238652-7867-4c1d-9dec-dbb1c46a099a req-b47e5147-fc3a-4164-b266-99a13c21c8c8 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 947 time: 0.0857515 Dec 09 14:45:41.886319 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:41.898945 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:41.966311 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=4d23a1cef80d45aa8c3b53af4403ed9c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3129902 Dec 09 14:45:41.967042 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c7b408a7-191d-4956-a8ef-773cb106e910,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:41.969020 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 57476) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:41.990179 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:41.990537 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:41.990939 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:41.991285 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:41.991638 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:41.991985 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:41.992324 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:41.992641 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:41.992993 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:41.993302 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:41.993627 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:41.993955 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:41.994601 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7388d7df-c123-4d19-9a33-a821e5af3f69 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:42.015211 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1a238652-7867-4c1d-9dec-dbb1c46a099a req-bdd22cec-8f88-4a9a-9647-782394d6897b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1243954 Dec 09 14:45:42.021829 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6b637cb5-46af-4e66-9520-468dd4039a11 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:42.031135 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74424bfd-5c15-4ac9-b0c2-eb24fa7ed55b req-814c5dea-9d55-4859-ac96-142f90a13af9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:42.032905 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-74424bfd-5c15-4ac9-b0c2-eb24fa7ed55b req-814c5dea-9d55-4859-ac96-142f90a13af9 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 1100 time: 0.0597415 Dec 09 14:45:42.044409 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6b637cb5-46af-4e66-9520-468dd4039a11 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:42.080054 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-74424bfd-5c15-4ac9-b0c2-eb24fa7ed55b req-7a4346fd-3799-408e-8211-3c4505d5ebd4 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0387053 Dec 09 14:45:42.090786 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6b637cb5-46af-4e66-9520-468dd4039a11 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:42.094021 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6b637cb5-46af-4e66-9520-468dd4039a11 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:42.095198 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-6b637cb5-46af-4e66-9520-468dd4039a11 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/c7b408a7-191d-4956-a8ef-773cb106e910 HTTP/1.1" status: 204 len: 168 time: 0.1250875 Dec 09 14:45:42.103040 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b637cb5-46af-4e66-9520-468dd4039a11 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c7b408a7-191d-4956-a8ef-773cb106e910,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:42.379640 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 57484) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:42.396131 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-35180b32-33bc-49f0-bfd1-0303e8fb5f64 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:42.475504 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-35180b32-33bc-49f0-bfd1-0303e8fb5f64 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:42.480972 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-35180b32-33bc-49f0-bfd1-0303e8fb5f64 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:42.516751 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35180b32-33bc-49f0-bfd1-0303e8fb5f64 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a6e350d3-86cb-4dbd-b403-944c732e5304,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:42.521060 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-35180b32-33bc-49f0-bfd1-0303e8fb5f64 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=1b28e0f5d4664c6aa988ddaf24c32c7e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1400423 Dec 09 14:45:42.524946 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 57486) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:42.574989 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-38fb9e15-994d-4362-ab6b-f85a070c0f6a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:42.597158 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-38fb9e15-994d-4362-ab6b-f85a070c0f6a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:42.649092 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-38fb9e15-994d-4362-ab6b-f85a070c0f6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:42.651645 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-38fb9e15-994d-4362-ab6b-f85a070c0f6a admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:42.652806 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-38fb9e15-994d-4362-ab6b-f85a070c0f6a admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/a6e350d3-86cb-4dbd-b403-944c732e5304 HTTP/1.1" status: 204 len: 168 time: 0.1270366 Dec 09 14:45:42.660714 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-38fb9e15-994d-4362-ab6b-f85a070c0f6a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6e350d3-86cb-4dbd-b403-944c732e5304,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:43.164949 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd0b4025-609c-4ccd-929e-6768c0f181cc req-b2dd4acc-a39f-4ca0-90e8-1137df465f15 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:43.166416 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fd0b4025-609c-4ccd-929e-6768c0f181cc req-b2dd4acc-a39f-4ca0-90e8-1137df465f15 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 947 time: 0.0761757 Dec 09 14:45:43.191140 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c6e84020-17e7-4ce1-bf30-0a527b6ee2b8 req-e2296487-2893-411a-80a7-46260b7f10fd service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0664148 Dec 09 14:45:43.220889 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fd0b4025-609c-4ccd-929e-6768c0f181cc req-217fe8f2-3f32-41ee-bbd8-95053f6e71bf tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479596 Dec 09 14:45:43.265278 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e84020-17e7-4ce1-bf30-0a527b6ee2b8 req-97856479-69b1-4773-9eeb-7253fd874159 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:43.266860 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c6e84020-17e7-4ce1-bf30-0a527b6ee2b8 req-97856479-69b1-4773-9eeb-7253fd874159 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=3d298e3ebec54c2281ddf8bbb50b7cea&device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 1098 time: 0.0451090 Dec 09 14:45:43.372871 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 57518) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:43.388969 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e84020-17e7-4ce1-bf30-0a527b6ee2b8 req-afa89406-1078-4485-9309-c92c45c5a942 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:43.390772 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c6e84020-17e7-4ce1-bf30-0a527b6ee2b8 req-afa89406-1078-4485-9309-c92c45c5a942 service neutron] 10.222.0.44 "GET /v2.0/networks?id=8ff38a1e-5122-4806-8b7d-d4c281cbe550 HTTP/1.1" status: 200 len: 919 time: 0.0954182 Dec 09 14:45:43.458536 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c6e84020-17e7-4ce1-bf30-0a527b6ee2b8 req-e2d5fe5e-ba74-4fcb-9411-5f361eebae7b service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=bb290a6d-709a-49d1-bd2e-10c0fe664657 HTTP/1.1" status: 200 len: 217 time: 0.0432093 Dec 09 14:45:43.489722 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1921566986-network', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:45:43.520380 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6e84020-17e7-4ce1-bf30-0a527b6ee2b8 req-06da162b-bed1-4704-b4c5-d6e88daf64ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:43.522105 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c6e84020-17e7-4ce1-bf30-0a527b6ee2b8 req-06da162b-bed1-4704-b4c5-d6e88daf64ae service neutron] 10.222.0.44 "GET /v2.0/subnets?id=90388423-2d07-4cbe-80d8-fa2f6a3c14f7 HTTP/1.1" status: 200 len: 858 time: 0.0495353 Dec 09 14:45:43.535998 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] Made reservation on behalf of ed13d07c829a42dca57ff23f7538ecda for: {'network': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:45:43.538419 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:43.547360 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:43.562758 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c6e84020-17e7-4ce1-bf30-0a527b6ee2b8 req-a2e9380e-6d00-41b2-bff4-ff3e3cf36c89 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=8ff38a1e-5122-4806-8b7d-d4c281cbe550&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0300145 Dec 09 14:45:43.621223 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:43.626389 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:43.656915 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 426} {{(pid=109062) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:45:43.663796 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7073d18f-f08a-4238-9251-53b9b9bf0865,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:43.668483 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c6e84020-17e7-4ce1-bf30-0a527b6ee2b8 req-05f153e2-66a1-4b5b-a2f6-84f294519d3d service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866158 Dec 09 14:45:43.669821 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:43.670225 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.segments_db [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] Added segment d8b4a507-9bfc-4567-82ac-77b20844733a of type vlan for network ec211a40-6211-48b6-8014-deb1231b8f8a Dec 09 14:45:43.713763 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:43.743132 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:43.744847 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:43.745472 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:43.776514 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c6e84020-17e7-4ce1-bf30-0a527b6ee2b8 req-c5c8aac4-bd7d-4df0-b908-7038e65c7cab service neutron] 10.222.0.44 "GET /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0965621 Dec 09 14:45:43.808638 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.4346523 Dec 09 14:45:43.811374 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 57526) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:43.816283 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-c4f87852-f69d-4ad2-b2d6-122042b776d2 admin admin] Request body: {'subnet': {'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1921566986-subnet', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'ip_version': 4}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:45:43.825891 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bbf1689-1a0f-454f-b893-611f74fa436e admin admin] Pushing event updated for resources: {'Network': ['ID=ec211a40-6211-48b6-8014-deb1231b8f8a,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:43.836154 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network ec211a40-6211-48b6-8014-deb1231b8f8a details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:45:43.846045 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c4f87852-f69d-4ad2-b2d6-122042b776d2 admin admin] Made reservation on behalf of ed13d07c829a42dca57ff23f7538ecda for: {'subnet': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:45:43.848491 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c4f87852-f69d-4ad2-b2d6-122042b776d2 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-130588657'] for subnet, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.016584 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c4f87852-f69d-4ad2-b2d6-122042b776d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-130461295', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-130768923'] for subnet, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.070204 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4f87852-f69d-4ad2-b2d6-122042b776d2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3e261ed3-068f-4b13-8a79-5f90048fcbe6,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:44.078978 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c4f87852-f69d-4ad2-b2d6-122042b776d2 admin admin] Checking segment: {'id': 'd8b4a507-9bfc-4567-82ac-77b20844733a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109062) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:45:44.079334 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4f87852-f69d-4ad2-b2d6-122042b776d2 admin admin] Network hostable DHCP agents. Network: ec211a40-6211-48b6-8014-deb1231b8f8a, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109062) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:45:44.100766 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c4f87852-f69d-4ad2-b2d6-122042b776d2 admin admin] Network ec211a40-6211-48b6-8014-deb1231b8f8a is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109062) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:45:44.111957 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-c4f87852-f69d-4ad2-b2d6-122042b776d2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, ec211a40-6211-48b6-8014-deb1231b8f8a) {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:45:44.116387 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c4f87852-f69d-4ad2-b2d6-122042b776d2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:44.117111 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c4f87852-f69d-4ad2-b2d6-122042b776d2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.125987 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1ff80d86-ad4e-4f92-b671-dc5b0244a218 None None] Network ec211a40-6211-48b6-8014-deb1231b8f8a requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:45:44.144162 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-c4f87852-f69d-4ad2-b2d6-122042b776d2 admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3316472 Dec 09 14:45:44.144600 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 57544) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:44.150844 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:45:44.180391 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1626853', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30590'] for router, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.182145 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1626745', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1584168', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1653733', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30569'] for router, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.241958 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.371044 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp191c2114-7e35-566a-a422-2a0bb50a5442-ec211a40-6211-48b6-8014-deb1231b8f8a', 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'fixed_ips': [{'subnet_id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6'}]}} from dv-cinder-819692-8-iscsi. {{(pid=109063) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 14:45:44.372728 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.445973 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.460150 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57062f85-e505-43e7-9582-76b891f82ec1 req-56b706c6-b642-49b8-99bc-8c76f55ef7a5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:44.462689 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-57062f85-e505-43e7-9582-76b891f82ec1 req-56b706c6-b642-49b8-99bc-8c76f55ef7a5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 947 time: 0.1303582 Dec 09 14:45:44.527378 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.db_base_plugin_common [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Allocated IP 172.20.0.2 (ec211a40-6211-48b6-8014-deb1231b8f8a/3e261ed3-068f-4b13-8a79-5f90048fcbe6/5fb2858f-6ecf-4a2f-986f-7725989d9d69) {{(pid=109063) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:45:44.564154 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-57062f85-e505-43e7-9582-76b891f82ec1 req-e8832bd8-4f04-4563-aa20-38e87eccb7e0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0886118 Dec 09 14:45:44.672787 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Publish callbacks [] for port, precommit_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.679284 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.711187 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.717706 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Network ec211a40-6211-48b6-8014-deb1231b8f8a is already hosted by enough agents. {{(pid=109063) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:45:44.720670 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.base_scheduler [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Resources bound (agent type, host, resource id): {{(pid=109063) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:45:44.724278 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Received port after_create {{(pid=109063) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:45:44.732062 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.758325 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Pushing event updated for resources: {'Port': ['ID=5fb2858f-6ecf-4a2f-986f-7725989d9d69,revision_number=1']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:44.798262 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Attempting to bind port 5fb2858f-6ecf-4a2f-986f-7725989d9d69 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:45:44.798540 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Attempting to bind port 5fb2858f-6ecf-4a2f-986f-7725989d9d69 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'd8b4a507-9bfc-4567-82ac-77b20844733a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:45:44.799100 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Attempting to bind port 5fb2858f-6ecf-4a2f-986f-7725989d9d69 on network ec211a40-6211-48b6-8014-deb1231b8f8a {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:45:44.809103 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 45, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:45:44.809789 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Checking segment: {'id': 'd8b4a507-9bfc-4567-82ac-77b20844733a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:45:44.810348 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.810889 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Bound using segment: {'id': 'd8b4a507-9bfc-4567-82ac-77b20844733a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:45:44.811533 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Bound port: 5fb2858f-6ecf-4a2f-986f-7725989d9d69, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd8b4a507-9bfc-4567-82ac-77b20844733a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:45:44.812097 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.823635 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.846696 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Allocated IP 172.27.0.214 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:45:44.887552 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] For port 5fb2858f-6ecf-4a2f-986f-7725989d9d69, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:45:44.893456 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] For port 5fb2858f-6ecf-4a2f-986f-7725989d9d69, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=5fb2858f-6ecf-4a2f-986f-7725989d9d69,segment=NetworkSegment(d8b4a507-9bfc-4567-82ac-77b20844733a),segment_id=d8b4a507-9bfc-4567-82ac-77b20844733a)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:45:44.899597 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:44.959411 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13745686-2ba4-4c2a-a6f4-00b7b8b84d20 None None] Pushing event updated for resources: {'Port': ['ID=5fb2858f-6ecf-4a2f-986f-7725989d9d69,revision_number=2']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:44.997639 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:45.032653 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:45.075244 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:45:45.078229 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:45:45.084223 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:45:45.087922 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Pushing event updated for resources: {'Port': ['ID=8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:45.347359 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:45.549259 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1626736', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1574391'] for router, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:45.718924 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed18581-b13a-427b-bf94-0e26a1373fdf req-2b8e0095-6c60-4913-a506-c39a57f24521 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:45.720540 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-eed18581-b13a-427b-bf94-0e26a1373fdf req-2b8e0095-6c60-4913-a506-c39a57f24521 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 947 time: 0.0731747 Dec 09 14:45:45.734980 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Router 24108286-6fa2-4e97-9fab-de1871d0c79d is scheduled to L3 agent d9048829-2654-4d94-83cc-155a0884505e with binding_index 1 {{(pid=109061) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 14:45:45.811928 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-eed18581-b13a-427b-bf94-0e26a1373fdf req-b5b6f170-d81d-4207-a8d0-3a1762ed7f8b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0847960 Dec 09 14:45:45.878112 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:45:45.880938 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e0e37586-3d4b-4cd2-9810-f5334f060057 None None] Network ec211a40-6211-48b6-8014-deb1231b8f8a requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:45:45.889678 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Sync routers for ids ['24108286-6fa2-4e97-9fab-de1871d0c79d'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:45:45.900789 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Routers {'24108286-6fa2-4e97-9fab-de1871d0c79d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:45:45.901390 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-f949a496-311f-4671-a379-cd15900c7783 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:45:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['24108286-6fa2-4e97-9fab-de1871d0c79d'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:45.913355 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:45.917664 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 57578) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:45.918804 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-d649039f-52cd-43e6-b20a-b9e2c46566f1 admin admin] 10.222.0.39 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 1.7725632 Dec 09 14:45:46.009081 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-a057a14d-9758-4181-acbc-f37b5aaf3bb5 None None] Provisioning complete for port 5fb2858f-6ecf-4a2f-986f-7725989d9d69 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:46.009686 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-a057a14d-9758-4181-acbc-f37b5aaf3bb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:46.018713 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Set router 24108286-6fa2-4e97-9fab-de1871d0c79d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:45:46.100406 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-a057a14d-9758-4181-acbc-f37b5aaf3bb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:46.143087 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-a057a14d-9758-4181-acbc-f37b5aaf3bb5 None None] For port 5fb2858f-6ecf-4a2f-986f-7725989d9d69, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=5fb2858f-6ecf-4a2f-986f-7725989d9d69,segment=NetworkSegment(d8b4a507-9bfc-4567-82ac-77b20844733a),segment_id=d8b4a507-9bfc-4567-82ac-77b20844733a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:45:46.150985 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-a057a14d-9758-4181-acbc-f37b5aaf3bb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:46.210776 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a057a14d-9758-4181-acbc-f37b5aaf3bb5 None None] Pushing event updated for resources: {'Port': ['ID=5fb2858f-6ecf-4a2f-986f-7725989d9d69,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:46.218965 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-f949a496-311f-4671-a379-cd15900c7783 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:45Z', 'revision_number': 3, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'gw_port': {'id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:56:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:44Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:46.245847 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Checking router: 24108286-6fa2-4e97-9fab-de1871d0c79d for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:45:46.246196 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Updating router 24108286-6fa2-4e97-9fab-de1871d0c79d port 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e binding host dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:45:46.272423 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:46.273889 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-631fc6b7-3d77-414c-8a32-1835bfa44cea None None] Provisioning complete for port 5fb2858f-6ecf-4a2f-986f-7725989d9d69 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:46.274253 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-631fc6b7-3d77-414c-8a32-1835bfa44cea None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:46.379459 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:46.548937 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Publish callbacks [] for port, precommit_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:46.557118 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Allocated IP 172.20.0.1 (ec211a40-6211-48b6-8014-deb1231b8f8a/3e261ed3-068f-4b13-8a79-5f90048fcbe6/f8899dd4-cd7b-4334-8f00-998be8a48481) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:45:46.557917 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:46.681799 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:46.698006 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Attempting to bind port 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:45:46.698380 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Attempting to bind port 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:45:46.698742 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Attempting to bind port 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e on network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:45:46.705720 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51d3df4f-fdc8-4403-86b9-dd482642a6ff None None] Pushing event updated for resources: {'Port': ['ID=8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e,revision_number=2']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:46.712906 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51d3df4f-fdc8-4403-86b9-dd482642a6ff None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:46.713326 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51d3df4f-fdc8-4403-86b9-dd482642a6ff None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:46.713711 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51d3df4f-fdc8-4403-86b9-dd482642a6ff None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:46.714401 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51d3df4f-fdc8-4403-86b9-dd482642a6ff None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:46.714508 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51d3df4f-fdc8-4403-86b9-dd482642a6ff None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:46.714798 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51d3df4f-fdc8-4403-86b9-dd482642a6ff None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:46.715199 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51d3df4f-fdc8-4403-86b9-dd482642a6ff None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:46.715533 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51d3df4f-fdc8-4403-86b9-dd482642a6ff None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:46.715915 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51d3df4f-fdc8-4403-86b9-dd482642a6ff None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:46.716257 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51d3df4f-fdc8-4403-86b9-dd482642a6ff None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:46.716588 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51d3df4f-fdc8-4403-86b9-dd482642a6ff None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:46.716911 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51d3df4f-fdc8-4403-86b9-dd482642a6ff None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:46.717231 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-51d3df4f-fdc8-4403-86b9-dd482642a6ff None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:46.717717 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:46.721800 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 45, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:45:46.722314 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Checking segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109064) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:45:46.722770 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:46.723196 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Bound using segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:45:46.723714 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Bound port: 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:45:46.724123 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:46.759061 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Network ec211a40-6211-48b6-8014-deb1231b8f8a is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:45:46.765192 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:45:46.769047 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:45:46.776127 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-f949a496-311f-4671-a379-cd15900c7783 None None] For port 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109064) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:45:46.779460 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-f949a496-311f-4671-a379-cd15900c7783 None None] For port 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109064) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:45:46.785945 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:46.797367 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Pushing event updated for resources: {'Port': ['ID=f8899dd4-cd7b-4334-8f00-998be8a48481,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:46.817177 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1574184'] for router_interface, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:46.843507 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Routers {'24108286-6fa2-4e97-9fab-de1871d0c79d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:45:46.844159 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-f949a496-311f-4671-a379-cd15900c7783 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:45:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['24108286-6fa2-4e97-9fab-de1871d0c79d'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:46.890882 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51d3df4f-fdc8-4403-86b9-dd482642a6ff None None] Pushing event updated for resources: {'Port': ['ID=8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e,revision_number=3']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:46.976217 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-f949a496-311f-4671-a379-cd15900c7783 None None] Set router 24108286-6fa2-4e97-9fab-de1871d0c79d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:45:46.989937 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:47.033147 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-db075517-63e7-4831-8bbd-a5ab845f05f7 None None] Provisioning complete for port f8899dd4-cd7b-4334-8f00-998be8a48481 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:47.034296 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-db075517-63e7-4831-8bbd-a5ab845f05f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:47.104378 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-db075517-63e7-4831-8bbd-a5ab845f05f7 None None] Port f8899dd4-cd7b-4334-8f00-998be8a48481 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:45:47.192425 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 5fb2858f-6ecf-4a2f-986f-7725989d9d69 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:45:47.261093 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 5fb2858f-6ecf-4a2f-986f-7725989d9d69 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:47.261473 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:47.268506 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:47.274729 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-130461426'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:47.299633 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2688dc3-a8b2-4549-ab4a-5cef8d9ad35d req-2a1641c3-dd22-416c-bca9-553b08bcd6d0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:47.307282 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e2688dc3-a8b2-4549-ab4a-5cef8d9ad35d req-2a1641c3-dd22-416c-bca9-553b08bcd6d0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 947 time: 0.3913803 Dec 09 14:45:47.312981 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-f949a496-311f-4671-a379-cd15900c7783 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:45Z', 'revision_number': 3, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'gw_port': {'id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:56:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:47.338328 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2066007', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1629368'] for router_interface, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:47.341657 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f949a496-311f-4671-a379-cd15900c7783 None None] The sync data for ids ['24108286-6fa2-4e97-9fab-de1871d0c79d'] in dv-cinder-819692-8-iscsi is: [{'id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:45Z', 'revision_number': 3, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'gw_port': {'id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:56:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:45:47.356389 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e2688dc3-a8b2-4549-ab4a-5cef8d9ad35d req-7dd3aea6-a221-49fe-81d9-ca27c68329ff tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481155 Dec 09 14:45:47.424343 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Pushing event updated for resources: {'Port': ['ID=f8899dd4-cd7b-4334-8f00-998be8a48481,revision_number=2']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:47.470039 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Network ec211a40-6211-48b6-8014-deb1231b8f8a is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:45:47.471585 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:45:47.657864 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Router 24108286-6fa2-4e97-9fab-de1871d0c79d has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:45:47.823989 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:45:47.830016 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-6aee6b40-3622-4f1e-bcec-bff3e50308cc admin admin] 10.222.0.39 "PUT /v2.0/routers/24108286-6fa2-4e97-9fab-de1871d0c79d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9101424 Dec 09 14:45:47.836105 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-9100c170-e8a8-4943-a613-c3912aaf7df7 None None] Provisioning complete for port f8899dd4-cd7b-4334-8f00-998be8a48481 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:47.836815 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-9100c170-e8a8-4943-a613-c3912aaf7df7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:47.878210 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-9100c170-e8a8-4943-a613-c3912aaf7df7 None None] Port f8899dd4-cd7b-4334-8f00-998be8a48481 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:45:48.359054 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 57616) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:48.364188 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1608639764-network', 'tenant_id': 'aa21c3a67db0467f939fcab87f0358ac'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:45:48.389606 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] Made reservation on behalf of aa21c3a67db0467f939fcab87f0358ac for: {'network': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:45:48.391902 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:48.402255 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:48.485668 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:48.491468 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:48.492470 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5bd720d-e34a-4448-823a-37fbbf0e3e72 req-2d0a76b4-dfce-416f-9d3d-f587148f443b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:48.494353 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b5bd720d-e34a-4448-823a-37fbbf0e3e72 req-2d0a76b4-dfce-416f-9d3d-f587148f443b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 947 time: 0.0546381 Dec 09 14:45:48.520433 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 420} {{(pid=109062) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:45:48.530281 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b37ef26-27cb-4111-82eb-4db42edef6a5,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:48.535747 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:48.536125 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.segments_db [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] Added segment 88bbc0ad-3992-4920-a16f-cea3a608ea88 of type vlan for network cb4a18f0-1b41-4505-8209-f321fa2fb718 Dec 09 14:45:48.545715 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b5bd720d-e34a-4448-823a-37fbbf0e3e72 req-60d24c1b-d449-4690-8cea-394d5d29d70a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441194 Dec 09 14:45:48.579131 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:48.607465 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:48.608567 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:48.609334 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:48.662382 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.3021157 Dec 09 14:45:48.665242 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 57622) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:48.670209 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-841bb36f-e05e-46e2-a418-1786df407aa2 admin admin] Request body: {'subnet': {'network_id': 'cb4a18f0-1b41-4505-8209-f321fa2fb718', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1608639764-subnet', 'tenant_id': 'aa21c3a67db0467f939fcab87f0358ac', 'ip_version': 4}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:45:48.672420 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3c1cfa67-5010-410c-a887-8fbd297f76e6 admin admin] Pushing event updated for resources: {'Network': ['ID=cb4a18f0-1b41-4505-8209-f321fa2fb718,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:48.683768 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network cb4a18f0-1b41-4505-8209-f321fa2fb718 details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:45:48.699846 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-841bb36f-e05e-46e2-a418-1786df407aa2 admin admin] Made reservation on behalf of aa21c3a67db0467f939fcab87f0358ac for: {'subnet': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:45:48.703440 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-841bb36f-e05e-46e2-a418-1786df407aa2 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-133483919'] for subnet, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:48.881071 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-841bb36f-e05e-46e2-a418-1786df407aa2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-133412248', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-133640805'] for subnet, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:48.939967 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-841bb36f-e05e-46e2-a418-1786df407aa2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b521ad48-f786-4d81-985a-213254001050,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:48.949010 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-841bb36f-e05e-46e2-a418-1786df407aa2 admin admin] Checking segment: {'id': '88bbc0ad-3992-4920-a16f-cea3a608ea88', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 420, 'network_id': 'cb4a18f0-1b41-4505-8209-f321fa2fb718'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:45:48.949367 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-841bb36f-e05e-46e2-a418-1786df407aa2 admin admin] Network hostable DHCP agents. Network: cb4a18f0-1b41-4505-8209-f321fa2fb718, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109061) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:45:48.968010 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-841bb36f-e05e-46e2-a418-1786df407aa2 admin admin] Network cb4a18f0-1b41-4505-8209-f321fa2fb718 is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109061) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:45:48.978273 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-841bb36f-e05e-46e2-a418-1786df407aa2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, cb4a18f0-1b41-4505-8209-f321fa2fb718) {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:45:48.982453 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-841bb36f-e05e-46e2-a418-1786df407aa2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:48.983073 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-841bb36f-e05e-46e2-a418-1786df407aa2 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:48.990748 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a9ba21db-2786-4565-b256-3f19cb345c15 None None] Network cb4a18f0-1b41-4505-8209-f321fa2fb718 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:45:49.004935 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-841bb36f-e05e-46e2-a418-1786df407aa2 admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3375311 Dec 09 14:45:49.006691 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 57626) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:49.011387 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1608639764-router', 'tenant_id': 'aa21c3a67db0467f939fcab87f0358ac', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:45:49.044663 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1626853', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30590'] for router, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:49.045879 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1626745', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1584168', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1653733', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30569'] for router, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:49.053677 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Sync routers for ids ['24108286-6fa2-4e97-9fab-de1871d0c79d'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:45:49.083577 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Routers {'24108286-6fa2-4e97-9fab-de1871d0c79d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:45:49.084246 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:45:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['24108286-6fa2-4e97-9fab-de1871d0c79d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:49.103998 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:49.126272 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:45:49.218961 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp191c2114-7e35-566a-a422-2a0bb50a5442-cb4a18f0-1b41-4505-8209-f321fa2fb718', 'network_id': 'cb4a18f0-1b41-4505-8209-f321fa2fb718', 'project_id': 'aa21c3a67db0467f939fcab87f0358ac', 'fixed_ips': [{'subnet_id': 'b521ad48-f786-4d81-985a-213254001050'}]}} from dv-cinder-819692-8-iscsi. {{(pid=109063) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 14:45:49.219852 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:49.242255 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:49.270287 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Set router 24108286-6fa2-4e97-9fab-de1871d0c79d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:45:49.355857 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:49.356131 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:49.447417 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:49.467781 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:49.530869 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.db_base_plugin_common [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Allocated IP 172.20.0.2 (cb4a18f0-1b41-4505-8209-f321fa2fb718/b521ad48-f786-4d81-985a-213254001050/c380382f-4523-4464-b4ea-7bf6c35b35d8) {{(pid=109063) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:45:49.575171 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Allocated IP 172.27.0.181 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/7b23c792-8975-498e-95fb-ead891ed2cec) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:45:49.652004 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:49.680183 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] For port 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:45:49.681054 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:49.696041 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:49.722995 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:49.763775 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:45:49.769719 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:45:49.772306 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:45:49.808858 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Pushing event updated for resources: {'Port': ['ID=7b23c792-8975-498e-95fb-ead891ed2cec,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:49.916241 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Pushing event updated for resources: {'Port': ['ID=8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:49.930661 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:49.931040 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:49.931392 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:49.931777 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:49.932094 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:49.932426 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:49.932760 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:49.933316 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:49.933634 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:49.934215 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:49.934327 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:49.934619 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:49.934945 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:45:49.951641 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Publish callbacks [] for port, precommit_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:49.954441 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:46Z', 'revision_number': 4, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'gw_port': {'id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:56:42', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:46Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'f8899dd4-cd7b-4334-8f00-998be8a48481', 'name': '', 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'mac_address': 'fa:16:3e:c0:25:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:46Z', 'updated_at': '2021-12-09T14:45:47Z', 'revision_number': 2, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'subnets': [{'id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:49.982125 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Checking router: 24108286-6fa2-4e97-9fab-de1871d0c79d for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:45:49.982480 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Updating router 24108286-6fa2-4e97-9fab-de1871d0c79d port f8899dd4-cd7b-4334-8f00-998be8a48481 binding host dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:45:49.984692 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:50.041629 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:50.042199 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Network cb4a18f0-1b41-4505-8209-f321fa2fb718 is already hosted by enough agents. {{(pid=109063) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:45:50.044752 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:50.050274 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.base_scheduler [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Resources bound (agent type, host, resource id): {{(pid=109063) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:45:50.060084 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Received port after_create {{(pid=109063) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:45:50.067850 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Pushing event updated for resources: {'Port': ['ID=c380382f-4523-4464-b4ea-7bf6c35b35d8,revision_number=1']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:50.190355 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Attempting to bind port c380382f-4523-4464-b4ea-7bf6c35b35d8 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:45:50.190604 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Attempting to bind port c380382f-4523-4464-b4ea-7bf6c35b35d8 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': '88bbc0ad-3992-4920-a16f-cea3a608ea88', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 420, 'network_id': 'cb4a18f0-1b41-4505-8209-f321fa2fb718'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:45:50.191002 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Attempting to bind port c380382f-4523-4464-b4ea-7bf6c35b35d8 on network cb4a18f0-1b41-4505-8209-f321fa2fb718 {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:45:50.204854 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 45, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:45:50.205229 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Checking segment: {'id': '88bbc0ad-3992-4920-a16f-cea3a608ea88', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 420, 'network_id': 'cb4a18f0-1b41-4505-8209-f321fa2fb718'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:45:50.205629 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:50.206021 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Bound using segment: {'id': '88bbc0ad-3992-4920-a16f-cea3a608ea88', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 420, 'network_id': 'cb4a18f0-1b41-4505-8209-f321fa2fb718'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:45:50.206497 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Bound port: c380382f-4523-4464-b4ea-7bf6c35b35d8, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '88bbc0ad-3992-4920-a16f-cea3a608ea88', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 420, 'network_id': 'cb4a18f0-1b41-4505-8209-f321fa2fb718'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:45:50.206876 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:50.239897 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1626736', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1574391'] for router, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:50.336566 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] For port c380382f-4523-4464-b4ea-7bf6c35b35d8, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:45:50.344121 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] For port c380382f-4523-4464-b4ea-7bf6c35b35d8, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=c380382f-4523-4464-b4ea-7bf6c35b35d8,segment=NetworkSegment(88bbc0ad-3992-4920-a16f-cea3a608ea88),segment_id=88bbc0ad-3992-4920-a16f-cea3a608ea88)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:45:50.350032 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:50.388664 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Router fac36cef-4c08-4e2d-859e-cc78861e8157 is scheduled to L3 agent d9048829-2654-4d94-83cc-155a0884505e with binding_index 1 {{(pid=109061) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 14:45:50.452703 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-269ebd91-8118-4810-be89-86a7bb775441 None None] Pushing event updated for resources: {'Port': ['ID=c380382f-4523-4464-b4ea-7bf6c35b35d8,revision_number=2']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:50.472192 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Publish callbacks [] for port, precommit_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:50.479398 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:50.505424 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:45:50.522619 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Sync routers for ids ['fac36cef-4c08-4e2d-859e-cc78861e8157'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:45:50.523818 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:50.524963 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-3782e77c-f564-4d87-905b-cd049f530cf4 admin admin] 10.222.0.39 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 1.5172634 Dec 09 14:45:50.527907 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 57634) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:45:50.532430 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7292ba3-3501-4710-b864-242d8249ba9a None None] Pushing event updated for resources: {'Port': ['ID=f8899dd4-cd7b-4334-8f00-998be8a48481,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:50.546336 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Routers {'fac36cef-4c08-4e2d-859e-cc78861e8157'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:45:50.546958 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:45:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['fac36cef-4c08-4e2d-859e-cc78861e8157'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:50.583361 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Attempting to bind port f8899dd4-cd7b-4334-8f00-998be8a48481 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:45:50.583906 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Attempting to bind port f8899dd4-cd7b-4334-8f00-998be8a48481 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'd8b4a507-9bfc-4567-82ac-77b20844733a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:45:50.584336 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Attempting to bind port f8899dd4-cd7b-4334-8f00-998be8a48481 on network ec211a40-6211-48b6-8014-deb1231b8f8a {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:45:50.593681 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 45, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:45:50.594601 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Checking segment: {'id': 'd8b4a507-9bfc-4567-82ac-77b20844733a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:45:50.594601 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:50.594821 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Bound using segment: {'id': 'd8b4a507-9bfc-4567-82ac-77b20844733a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:45:50.595300 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Bound port: f8899dd4-cd7b-4334-8f00-998be8a48481, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd8b4a507-9bfc-4567-82ac-77b20844733a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:45:50.596280 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:50.724372 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Set router fac36cef-4c08-4e2d-859e-cc78861e8157 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:45:50.731364 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] For port f8899dd4-cd7b-4334-8f00-998be8a48481, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:45:50.736586 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] For port f8899dd4-cd7b-4334-8f00-998be8a48481, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=f8899dd4-cd7b-4334-8f00-998be8a48481,segment=NetworkSegment(d8b4a507-9bfc-4567-82ac-77b20844733a),segment_id=d8b4a507-9bfc-4567-82ac-77b20844733a)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:45:50.743758 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:50.814205 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Routers {'24108286-6fa2-4e97-9fab-de1871d0c79d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:45:50.814757 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:45:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['24108286-6fa2-4e97-9fab-de1871d0c79d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:50.857623 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7292ba3-3501-4710-b864-242d8249ba9a None None] Pushing event updated for resources: {'Port': ['ID=f8899dd4-cd7b-4334-8f00-998be8a48481,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:50.952742 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-754ac534-9948-4f80-9dd1-02b53816fdac None None] Provisioning complete for port f8899dd4-cd7b-4334-8f00-998be8a48481 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:50.953118 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-754ac534-9948-4f80-9dd1-02b53816fdac None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.027529 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'name': 'tempest-TestMinimumBasicScenario-1608639764-router', 'tenant_id': 'aa21c3a67db0467f939fcab87f0358ac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.181'}], 'enable_snat': True}, 'gw_port_id': '7b23c792-8975-498e-95fb-ead891ed2cec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:45:49Z', 'revision_number': 3, 'project_id': 'aa21c3a67db0467f939fcab87f0358ac', 'gw_port': {'id': '7b23c792-8975-498e-95fb-ead891ed2cec', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:6f:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:45:49Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:51.035099 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] Set router 24108286-6fa2-4e97-9fab-de1871d0c79d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:45:51.064414 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Checking router: fac36cef-4c08-4e2d-859e-cc78861e8157 for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:45:51.064533 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Updating router fac36cef-4c08-4e2d-859e-cc78861e8157 port 7b23c792-8975-498e-95fb-ead891ed2cec binding host dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:45:51.100020 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-754ac534-9948-4f80-9dd1-02b53816fdac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.113009 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.210388 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-754ac534-9948-4f80-9dd1-02b53816fdac None None] For port f8899dd4-cd7b-4334-8f00-998be8a48481, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=f8899dd4-cd7b-4334-8f00-998be8a48481,segment=NetworkSegment(d8b4a507-9bfc-4567-82ac-77b20844733a),segment_id=d8b4a507-9bfc-4567-82ac-77b20844733a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:45:51.219567 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-754ac534-9948-4f80-9dd1-02b53816fdac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.254160 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.278951 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-754ac534-9948-4f80-9dd1-02b53816fdac None None] Pushing event updated for resources: {'Port': ['ID=f8899dd4-cd7b-4334-8f00-998be8a48481,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:51.281730 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:45:51.397244 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-60e6428c-8a1f-4b89-92d2-1aaafc1abe1a None None] Provisioning complete for port f8899dd4-cd7b-4334-8f00-998be8a48481 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:51.397624 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-60e6428c-8a1f-4b89-92d2-1aaafc1abe1a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.432108 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:46Z', 'revision_number': 4, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'gw_port': {'id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:56:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'f8899dd4-cd7b-4334-8f00-998be8a48481', 'name': '', 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'mac_address': 'fa:16:3e:c0:25:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:46Z', 'updated_at': '2021-12-09T14:45:50Z', 'revision_number': 4, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'subnets': [{'id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:51.438456 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:51.438835 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.439856 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Publish callbacks [] for port, precommit_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.449152 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.478270 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Allocated IP 172.20.0.1 (cb4a18f0-1b41-4505-8209-f321fa2fb718/b521ad48-f786-4d81-985a-213254001050/0893b89a-a8f4-46d8-8199-f1d43ad13d5e) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:45:51.513425 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-237059e0-1a6b-47c1-a451-a1fab8b6f127 None None] The sync data for ids ['24108286-6fa2-4e97-9fab-de1871d0c79d'] in dv-cinder-819692-8-iscsi is: [{'id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:46Z', 'revision_number': 4, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'gw_port': {'id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:56:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'f8899dd4-cd7b-4334-8f00-998be8a48481', 'name': '', 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'mac_address': 'fa:16:3e:c0:25:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:46Z', 'updated_at': '2021-12-09T14:45:50Z', 'revision_number': 4, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'subnets': [{'id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:45:51.522547 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Attempting to bind port 7b23c792-8975-498e-95fb-ead891ed2cec on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:45:51.523125 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Attempting to bind port 7b23c792-8975-498e-95fb-ead891ed2cec by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:45:51.524126 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Attempting to bind port 7b23c792-8975-498e-95fb-ead891ed2cec on network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:45:51.539856 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-943b916d-4a9f-46bb-a1bd-00bc4c51aee7 None None] Pushing event updated for resources: {'Port': ['ID=7b23c792-8975-498e-95fb-ead891ed2cec,revision_number=2']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:51.551132 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 45, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:45:51.551679 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Checking segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109064) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:45:51.552166 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.553107 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Bound using segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:45:51.553613 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Bound port: 7b23c792-8975-498e-95fb-ead891ed2cec, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:45:51.554070 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.647348 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] For port 7b23c792-8975-498e-95fb-ead891ed2cec, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109064) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:45:51.653949 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] For port 7b23c792-8975-498e-95fb-ead891ed2cec, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=7b23c792-8975-498e-95fb-ead891ed2cec,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109064) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:45:51.662238 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.676685 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.707979 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device c380382f-4523-4464-b4ea-7bf6c35b35d8 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:45:51.769568 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.775646 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Routers {'fac36cef-4c08-4e2d-859e-cc78861e8157'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:45:51.776478 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port c380382f-4523-4464-b4ea-7bf6c35b35d8 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:51.777053 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:45:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['fac36cef-4c08-4e2d-859e-cc78861e8157'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:51.782387 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.811802 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Network cb4a18f0-1b41-4505-8209-f321fa2fb718 is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:45:51.814611 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:45:51.817186 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:45:51.856405 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Pushing event updated for resources: {'Port': ['ID=0893b89a-a8f4-46d8-8199-f1d43ad13d5e,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:51.875847 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1574184'] for router_interface, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.896424 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:51.908921 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3a63a64-4ba3-4942-9856-d0e4f3ad0edc None None] Network cb4a18f0-1b41-4505-8209-f321fa2fb718 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:45:51.940800 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] Set router fac36cef-4c08-4e2d-859e-cc78861e8157 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:45:52.015731 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] For port c380382f-4523-4464-b4ea-7bf6c35b35d8, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=c380382f-4523-4464-b4ea-7bf6c35b35d8,segment=NetworkSegment(88bbc0ad-3992-4920-a16f-cea3a608ea88),segment_id=88bbc0ad-3992-4920-a16f-cea3a608ea88)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:45:52.030672 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-0cc46a25-41a9-4bc2-9e72-86a9a9b40455 None None] Provisioning complete for port c380382f-4523-4464-b4ea-7bf6c35b35d8 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:52.031235 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-0cc46a25-41a9-4bc2-9e72-86a9a9b40455 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:52.056745 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:52.072187 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:52.277704 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-943b916d-4a9f-46bb-a1bd-00bc4c51aee7 None None] Pushing event updated for resources: {'Port': ['ID=7b23c792-8975-498e-95fb-ead891ed2cec,revision_number=3']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:52.304295 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:52.308495 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'name': 'tempest-TestMinimumBasicScenario-1608639764-router', 'tenant_id': 'aa21c3a67db0467f939fcab87f0358ac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.181'}], 'enable_snat': True}, 'gw_port_id': '7b23c792-8975-498e-95fb-ead891ed2cec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:45:49Z', 'revision_number': 3, 'project_id': 'aa21c3a67db0467f939fcab87f0358ac', 'gw_port': {'id': '7b23c792-8975-498e-95fb-ead891ed2cec', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:6f:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:45:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:52.310859 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-130461426'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:52.340173 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7f522ce7-8d75-4511-b3f2-bfce6640c32b None None] The sync data for ids ['fac36cef-4c08-4e2d-859e-cc78861e8157'] in dv-cinder-819692-8-iscsi is: [{'id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'name': 'tempest-TestMinimumBasicScenario-1608639764-router', 'tenant_id': 'aa21c3a67db0467f939fcab87f0358ac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.181'}], 'enable_snat': True}, 'gw_port_id': '7b23c792-8975-498e-95fb-ead891ed2cec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:45:49Z', 'revision_number': 3, 'project_id': 'aa21c3a67db0467f939fcab87f0358ac', 'gw_port': {'id': '7b23c792-8975-498e-95fb-ead891ed2cec', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:6f:cd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:45:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:45:52.362732 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Pushing event updated for resources: {'Port': ['ID=c380382f-4523-4464-b4ea-7bf6c35b35d8,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:52.403986 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2066007', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1629368'] for router_interface, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:52.406761 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Pushing event updated for resources: {'Port': ['ID=0893b89a-a8f4-46d8-8199-f1d43ad13d5e,revision_number=2']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:52.510120 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Network cb4a18f0-1b41-4505-8209-f321fa2fb718 is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:45:52.511556 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:45:52.660333 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Router fac36cef-4c08-4e2d-859e-cc78861e8157 has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:45:52.672156 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-84ab98fd-45e7-41ef-9c63-aa6ef67377ae None None] Provisioning complete for port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:52.672574 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-84ab98fd-45e7-41ef-9c63-aa6ef67377ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:52.742386 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-84ab98fd-45e7-41ef-9c63-aa6ef67377ae None None] Port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:45:52.755751 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-84ab98fd-45e7-41ef-9c63-aa6ef67377ae None None] Provisioning complete for port c380382f-4523-4464-b4ea-7bf6c35b35d8 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:52.756131 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-84ab98fd-45e7-41ef-9c63-aa6ef67377ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:52.846069 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:45:52.851290 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-9dbd58d3-6e51-49f6-a16f-51b8f5243c1d admin admin] 10.222.0.39 "PUT /v2.0/routers/fac36cef-4c08-4e2d-859e-cc78861e8157/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3221865 Dec 09 14:45:53.017094 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-31cf9f8c-15cf-4329-90ee-27a1522a5e46 None None] Provisioning complete for port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:53.017554 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-31cf9f8c-15cf-4329-90ee-27a1522a5e46 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:53.084376 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-31cf9f8c-15cf-4329-90ee-27a1522a5e46 None None] Port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:45:53.213081 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-49d8cbc1-3f3b-49b8-a5c8-0df6e978e211 None None] Provisioning complete for port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:53.213723 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-49d8cbc1-3f3b-49b8-a5c8-0df6e978e211 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:53.247326 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 7b23c792-8975-498e-95fb-ead891ed2cec up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:45:53.298231 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-49d8cbc1-3f3b-49b8-a5c8-0df6e978e211 None None] Port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:45:53.320757 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 7b23c792-8975-498e-95fb-ead891ed2cec triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:53.321189 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:53.413660 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:53.438737 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] For port 7b23c792-8975-498e-95fb-ead891ed2cec, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=7b23c792-8975-498e-95fb-ead891ed2cec,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:45:53.444923 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:53.445830 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device f8899dd4-cd7b-4334-8f00-998be8a48481 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:45:53.522776 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Pushing event updated for resources: {'Port': ['ID=7b23c792-8975-498e-95fb-ead891ed2cec,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:53.536090 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port f8899dd4-cd7b-4334-8f00-998be8a48481 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:53.536473 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:53.657822 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device c380382f-4523-4464-b4ea-7bf6c35b35d8 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:45:53.720558 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port c380382f-4523-4464-b4ea-7bf6c35b35d8 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:53.720558 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:54.438908 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:45:55.084304 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 7b23c792-8975-498e-95fb-ead891ed2cec up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:45:55.141871 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 7b23c792-8975-498e-95fb-ead891ed2cec triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:55.142533 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:55.146836 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Sync routers for ids ['fac36cef-4c08-4e2d-859e-cc78861e8157'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:45:55.184545 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Routers {'fac36cef-4c08-4e2d-859e-cc78861e8157'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:45:55.185483 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:45:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['fac36cef-4c08-4e2d-859e-cc78861e8157'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:55.337528 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Set router fac36cef-4c08-4e2d-859e-cc78861e8157 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:45:55.571826 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'name': 'tempest-TestMinimumBasicScenario-1608639764-router', 'tenant_id': 'aa21c3a67db0467f939fcab87f0358ac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.181'}], 'enable_snat': True}, 'gw_port_id': '7b23c792-8975-498e-95fb-ead891ed2cec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:45:52Z', 'revision_number': 4, 'project_id': 'aa21c3a67db0467f939fcab87f0358ac', 'gw_port': {'id': '7b23c792-8975-498e-95fb-ead891ed2cec', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:6f:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:45:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '0893b89a-a8f4-46d8-8199-f1d43ad13d5e', 'name': '', 'network_id': 'cb4a18f0-1b41-4505-8209-f321fa2fb718', 'tenant_id': 'aa21c3a67db0467f939fcab87f0358ac', 'mac_address': 'fa:16:3e:30:66:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'device_owner': 'network:router_interface', 'standard_attr_id': 471, 'fixed_ips': [{'subnet_id': 'b521ad48-f786-4d81-985a-213254001050', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:51Z', 'updated_at': '2021-12-09T14:45:52Z', 'revision_number': 2, 'project_id': 'aa21c3a67db0467f939fcab87f0358ac', 'subnets': [{'id': 'b521ad48-f786-4d81-985a-213254001050', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:55.605955 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Checking router: fac36cef-4c08-4e2d-859e-cc78861e8157 for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:45:55.606359 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Updating router fac36cef-4c08-4e2d-859e-cc78861e8157 port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e binding host dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:45:55.632357 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:55.956424 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Publish callbacks [] for port, precommit_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:55.962444 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:56.061168 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70865c0e-56ff-4210-b264-4bce1373b2e1 None None] Pushing event updated for resources: {'Port': ['ID=0893b89a-a8f4-46d8-8199-f1d43ad13d5e,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:56.079025 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Attempting to bind port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:45:56.079025 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Attempting to bind port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': '88bbc0ad-3992-4920-a16f-cea3a608ea88', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 420, 'network_id': 'cb4a18f0-1b41-4505-8209-f321fa2fb718'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:45:56.079025 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Attempting to bind port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e on network cb4a18f0-1b41-4505-8209-f321fa2fb718 {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:45:56.084167 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 45, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:45:56.085287 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Checking segment: {'id': '88bbc0ad-3992-4920-a16f-cea3a608ea88', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 420, 'network_id': 'cb4a18f0-1b41-4505-8209-f321fa2fb718'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:45:56.085287 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:56.085931 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Bound using segment: {'id': '88bbc0ad-3992-4920-a16f-cea3a608ea88', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 420, 'network_id': 'cb4a18f0-1b41-4505-8209-f321fa2fb718'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:45:56.086128 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Bound port: 0893b89a-a8f4-46d8-8199-f1d43ad13d5e, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '88bbc0ad-3992-4920-a16f-cea3a608ea88', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 420, 'network_id': 'cb4a18f0-1b41-4505-8209-f321fa2fb718'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:45:56.086557 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:56.196896 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] For port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:45:56.200767 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] For port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=0893b89a-a8f4-46d8-8199-f1d43ad13d5e,segment=NetworkSegment(88bbc0ad-3992-4920-a16f-cea3a608ea88),segment_id=88bbc0ad-3992-4920-a16f-cea3a608ea88)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:45:56.207037 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:56.271853 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Routers {'fac36cef-4c08-4e2d-859e-cc78861e8157'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:45:56.272403 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:45:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['fac36cef-4c08-4e2d-859e-cc78861e8157'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:56.274296 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70865c0e-56ff-4210-b264-4bce1373b2e1 None None] Pushing event updated for resources: {'Port': ['ID=0893b89a-a8f4-46d8-8199-f1d43ad13d5e,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:56.591823 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-a958704a-5ab9-4315-9f82-72ae31f2610d None None] Provisioning complete for port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:56.593118 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-a958704a-5ab9-4315-9f82-72ae31f2610d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:56.597689 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] Set router fac36cef-4c08-4e2d-859e-cc78861e8157 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:45:56.795646 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-a958704a-5ab9-4315-9f82-72ae31f2610d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:56.859675 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-a958704a-5ab9-4315-9f82-72ae31f2610d None None] For port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=0893b89a-a8f4-46d8-8199-f1d43ad13d5e,segment=NetworkSegment(88bbc0ad-3992-4920-a16f-cea3a608ea88),segment_id=88bbc0ad-3992-4920-a16f-cea3a608ea88)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:45:56.867218 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-a958704a-5ab9-4315-9f82-72ae31f2610d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:56.931475 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a958704a-5ab9-4315-9f82-72ae31f2610d None None] Pushing event updated for resources: {'Port': ['ID=0893b89a-a8f4-46d8-8199-f1d43ad13d5e,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:45:56.936984 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'name': 'tempest-TestMinimumBasicScenario-1608639764-router', 'tenant_id': 'aa21c3a67db0467f939fcab87f0358ac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.181'}], 'enable_snat': True}, 'gw_port_id': '7b23c792-8975-498e-95fb-ead891ed2cec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:45:52Z', 'revision_number': 4, 'project_id': 'aa21c3a67db0467f939fcab87f0358ac', 'gw_port': {'id': '7b23c792-8975-498e-95fb-ead891ed2cec', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:6f:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:45:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '0893b89a-a8f4-46d8-8199-f1d43ad13d5e', 'name': '', 'network_id': 'cb4a18f0-1b41-4505-8209-f321fa2fb718', 'tenant_id': 'aa21c3a67db0467f939fcab87f0358ac', 'mac_address': 'fa:16:3e:30:66:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'device_owner': 'network:router_interface', 'standard_attr_id': 471, 'fixed_ips': [{'subnet_id': 'b521ad48-f786-4d81-985a-213254001050', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:51Z', 'updated_at': '2021-12-09T14:45:56Z', 'revision_number': 4, 'project_id': 'aa21c3a67db0467f939fcab87f0358ac', 'subnets': [{'id': 'b521ad48-f786-4d81-985a-213254001050', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:45:56.968724 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c2e57c21-010f-4f29-b654-40af6c8ba390 None None] The sync data for ids ['fac36cef-4c08-4e2d-859e-cc78861e8157'] in dv-cinder-819692-8-iscsi is: [{'id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'name': 'tempest-TestMinimumBasicScenario-1608639764-router', 'tenant_id': 'aa21c3a67db0467f939fcab87f0358ac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.181'}], 'enable_snat': True}, 'gw_port_id': '7b23c792-8975-498e-95fb-ead891ed2cec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:45:52Z', 'revision_number': 4, 'project_id': 'aa21c3a67db0467f939fcab87f0358ac', 'gw_port': {'id': '7b23c792-8975-498e-95fb-ead891ed2cec', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:6f:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:45:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '0893b89a-a8f4-46d8-8199-f1d43ad13d5e', 'name': '', 'network_id': 'cb4a18f0-1b41-4505-8209-f321fa2fb718', 'tenant_id': 'aa21c3a67db0467f939fcab87f0358ac', 'mac_address': 'fa:16:3e:30:66:cb', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'device_owner': 'network:router_interface', 'standard_attr_id': 471, 'fixed_ips': [{'subnet_id': 'b521ad48-f786-4d81-985a-213254001050', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:51Z', 'updated_at': '2021-12-09T14:45:56Z', 'revision_number': 4, 'project_id': 'aa21c3a67db0467f939fcab87f0358ac', 'subnets': [{'id': 'b521ad48-f786-4d81-985a-213254001050', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:45:57.015160 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-8176a352-c563-4dc9-a125-8d0f4e9088cd None None] Provisioning complete for port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:57.015543 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-8176a352-c563-4dc9-a125-8d0f4e9088cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:57.082379 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-83c0d88e-b674-4239-91ec-8c9817500f6e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:57.305088 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de1fbdaa-9f15-42e6-8432-3f67504439d7 req-5acfca9b-c991-4790-9595-f02a899435ee tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:57.312301 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de1fbdaa-9f15-42e6-8432-3f67504439d7 req-5acfca9b-c991-4790-9595-f02a899435ee tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0684631 Dec 09 14:45:57.366545 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de1fbdaa-9f15-42e6-8432-3f67504439d7 req-bb629c5a-9d5c-47e9-8aa1-3c90bcbc0fc1 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0531516 Dec 09 14:45:58.499524 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-955f1c2e-ad33-4b22-8c1a-c600a1a8e1d2 req-0bdaf37f-dfef-40c6-93c3-95c0839c905d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:58.503255 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-955f1c2e-ad33-4b22-8c1a-c600a1a8e1d2 req-0bdaf37f-dfef-40c6-93c3-95c0839c905d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0511007 Dec 09 14:45:58.572651 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-955f1c2e-ad33-4b22-8c1a-c600a1a8e1d2 req-85e1ddc7-19d2-4716-9a41-d8c657558974 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0609665 Dec 09 14:45:59.106932 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 0893b89a-a8f4-46d8-8199-f1d43ad13d5e up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:45:59.176907 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:45:59.177290 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:59.181486 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-827d34b0-b7db-474f-a025-eeb386b58b53 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:45:59.696780 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcb5ffb4-0b05-4c02-9cab-842b416f750a req-dceb34d1-645b-4fd0-8ca6-f96e46b575c7 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:45:59.698316 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fcb5ffb4-0b05-4c02-9cab-842b416f750a req-dceb34d1-645b-4fd0-8ca6-f96e46b575c7 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0558755 Dec 09 14:45:59.771755 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fcb5ffb4-0b05-4c02-9cab-842b416f750a req-8e360809-fb3b-4c85-a6b7-d12a81022338 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0583291 Dec 09 14:46:00.425524 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:00.449119 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7159066-ff88-472b-868a-ee8c41720907 req-15648200-dd24-4f37-8d41-63aa7b97bd44 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:00.450506 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f7159066-ff88-472b-868a-ee8c41720907 req-15648200-dd24-4f37-8d41-63aa7b97bd44 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.44 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 945 time: 0.0621533 Dec 09 14:46:00.560917 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-f7159066-ff88-472b-868a-ee8c41720907 req-bda8ea46-c280-4985-bfb0-79786e74d56e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Deleting port 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:46:00.561344 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-f7159066-ff88-472b-868a-ee8c41720907 req-bda8ea46-c280-4985-bfb0-79786e74d56e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:00.665000 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-f7159066-ff88-472b-868a-ee8c41720907 req-bda8ea46-c280-4985-bfb0-79786e74d56e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] For port 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6,segment=NetworkSegment(7ece4ded-a169-4d54-b911-54a5a65cd0ce),segment_id=7ece4ded-a169-4d54-b911-54a5a65cd0ce)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:46:00.665406 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-f7159066-ff88-472b-868a-ee8c41720907 req-bda8ea46-c280-4985-bfb0-79786e74d56e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:00.681229 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-f7159066-ff88-472b-868a-ee8c41720907 req-bda8ea46-c280-4985-bfb0-79786e74d56e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Calling delete_port for 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:46:00.898450 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-f7159066-ff88-472b-868a-ee8c41720907 req-bda8ea46-c280-4985-bfb0-79786e74d56e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:00.914218 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['bb290a6d-709a-49d1-bd2e-10c0fe664657', '2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:46:00.932782 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bda8ea46-c280-4985-bfb0-79786e74d56e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Pushing event deleted for resources: {'Port': ['ID=2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:00.998334 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfd0d5a7-eb91-413c-bd02-ae8c304cd009 req-d4efa26d-a22a-438c-8e52-2dad2520f2ee tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:00.999954 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bfd0d5a7-eb91-413c-bd02-ae8c304cd009 req-d4efa26d-a22a-438c-8e52-2dad2520f2ee tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=a496d15e-076c-47a9-9cc3-a0e61bed5ae0 HTTP/1.1" status: 200 len: 867 time: 0.1366982 Dec 09 14:46:01.000885 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-f7159066-ff88-472b-868a-ee8c41720907 req-bda8ea46-c280-4985-bfb0-79786e74d56e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] No DVR routers for this DVR port 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:46:01.003298 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-f7159066-ff88-472b-868a-ee8c41720907 req-bda8ea46-c280-4985-bfb0-79786e74d56e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:01.006746 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f7159066-ff88-472b-868a-ee8c41720907 req-bda8ea46-c280-4985-bfb0-79786e74d56e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.44 "DELETE /v2.0/ports/2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 HTTP/1.1" status: 204 len: 173 time: 0.5464816 Dec 09 14:46:01.007218 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a496d15e-076c-47a9-9cc3-a0e61bed5ae0', 'name': 'network-vif-deleted', 'tag': '2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:46:01.009569 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9ff39dc8-a9da-4a68-90ee-95dd74127d91" -d '{"events": [{"server_uuid": "a496d15e-076c-47a9-9cc3-a0e61bed5ae0", "name": "network-vif-deleted", "tag": "2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:46:01.065615 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bfd0d5a7-eb91-413c-bd02-ae8c304cd009 req-835cfd25-c828-4c1e-bf73-a37be567d2fe tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529728 Dec 09 14:46:01.093991 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:46:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7e6dac47-eedc-49f2-8aed-4a3dcb4eb2ae x-openstack-request-id: req-7e6dac47-eedc-49f2-8aed-4a3dcb4eb2ae {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:46:01.094297 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a496d15e-076c-47a9-9cc3-a0e61bed5ae0", "name": "network-vif-deleted", "tag": "2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:46:01.094575 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-7e6dac47-eedc-49f2-8aed-4a3dcb4eb2ae {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:46:01.094978 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a496d15e-076c-47a9-9cc3-a0e61bed5ae0', 'name': 'network-vif-deleted', 'tag': '2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6', 'status': 'completed', 'code': 200} Dec 09 14:46:01.394643 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac954283-ccfa-4519-9b6b-8cec97f3ff7c req-7156993d-6c81-44ac-a6e9-0c1b5ac8ddd3 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:01.400770 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ac954283-ccfa-4519-9b6b-8cec97f3ff7c req-7156993d-6c81-44ac-a6e9-0c1b5ac8ddd3 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 945 time: 0.0675592 Dec 09 14:46:01.475968 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ac954283-ccfa-4519-9b6b-8cec97f3ff7c req-4fcc45cc-bd45-4866-a488-06822f176333 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0653939 Dec 09 14:46:01.804226 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:02.388491 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f696e9d8-7510-40e6-bb96-e31cd8ffd54b req-33f321d2-d64e-4aee-b496-eb45a8a0c03d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:02.389917 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f696e9d8-7510-40e6-bb96-e31cd8ffd54b req-33f321d2-d64e-4aee-b496-eb45a8a0c03d tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0529222 Dec 09 14:46:02.440104 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f696e9d8-7510-40e6-bb96-e31cd8ffd54b req-a51e0e78-499b-418f-863d-36e3289ff0d8 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435631 Dec 09 14:46:02.591588 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73de525f-a528-4b60-8550-253b601ac070 req-852fa2a3-c948-40de-afc5-c1c9d3af29f9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:02.593166 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-73de525f-a528-4b60-8550-253b601ac070 req-852fa2a3-c948-40de-afc5-c1c9d3af29f9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 945 time: 0.0503137 Dec 09 14:46:02.619415 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:02.644124 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-73de525f-a528-4b60-8550-253b601ac070 req-a6f8b67c-04bc-4b3c-8d81-0476a0905e9e tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442166 Dec 09 14:46:03.128275 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-15e9604c-c23c-45e7-87fc-08a0b6dc960a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:03.129780 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-15e9604c-c23c-45e7-87fc-08a0b6dc960a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/networks?id=ec211a40-6211-48b6-8014-deb1231b8f8a HTTP/1.1" status: 200 len: 815 time: 0.1017647 Dec 09 14:46:03.144653 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-a1c0b33d-f732-4ec9-b5cd-9e87e312df20 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/quotas/ed13d07c829a42dca57ff23f7538ecda HTTP/1.1" status: 200 len: 375 time: 0.0090835 Dec 09 14:46:03.195206 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-6d10fb0c-e544-4f0e-b91b-3a03365c24b8 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=ed13d07c829a42dca57ff23f7538ecda&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0448406 Dec 09 14:46:03.256809 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:46:03.278188 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:46:03.278534 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 2bd83e4b-a6e9-4a44-b12b-cfddcbe62cd6 not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:46:03.291831 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-6b9660e9-7604-4482-9cf8-f7a358be1089 service neutron] 10.222.0.39 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841880 Dec 09 14:46:03.391087 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-26683a37-cbf7-45d9-8052-41727c6ba226 service neutron] 10.222.0.39 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0927353 Dec 09 14:46:03.551899 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-24fcd809-5f5e-40f6-8621-ae0b88e0ba39 req-89bc2bfa-5324-4eb6-8db1-833b0aadd8ff tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 210 time: 0.0263975 Dec 09 14:46:03.574725 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be910a08-ebd5-4d06-ad22-4306485d70c6 req-b6715311-f8b8-44c3-a831-43b2080f7b58 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:03.574725 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-be910a08-ebd5-4d06-ad22-4306485d70c6 req-b6715311-f8b8-44c3-a831-43b2080f7b58 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0556934 Dec 09 14:46:03.621302 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-be910a08-ebd5-4d06-ad22-4306485d70c6 req-d715fbbb-fbc8-414a-bad1-6a9296604081 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0458083 Dec 09 14:46:03.765312 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adf20dbc-2439-42a3-b693-54f7c2aa6c44 req-2e83dcec-387d-43c3-97f8-863da226ab5a tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:03.766767 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-adf20dbc-2439-42a3-b693-54f7c2aa6c44 req-2e83dcec-387d-43c3-97f8-863da226ab5a tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 945 time: 0.0550599 Dec 09 14:46:03.814744 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-adf20dbc-2439-42a3-b693-54f7c2aa6c44 req-b02c3f42-bf5e-4429-a6c1-70ea6d7cc041 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413253 Dec 09 14:46:03.901458 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fed4769b-0147-45cd-8c56-2425b42dfa69 req-9a1a8c72-cde3-456e-8e33-1ff1970ac51c tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:03.902922 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fed4769b-0147-45cd-8c56-2425b42dfa69 req-9a1a8c72-cde3-456e-8e33-1ff1970ac51c tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.44 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 945 time: 0.0475366 Dec 09 14:46:04.010948 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-fed4769b-0147-45cd-8c56-2425b42dfa69 req-e311c58a-9b74-458b-9b4a-09ab40ef103d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Deleting port 15210d7b-a185-432f-9885-014d180eb6b9 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:46:04.011298 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-fed4769b-0147-45cd-8c56-2425b42dfa69 req-e311c58a-9b74-458b-9b4a-09ab40ef103d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:04.111007 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-fed4769b-0147-45cd-8c56-2425b42dfa69 req-e311c58a-9b74-458b-9b4a-09ab40ef103d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] For port 15210d7b-a185-432f-9885-014d180eb6b9, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=15210d7b-a185-432f-9885-014d180eb6b9,segment=NetworkSegment(e2f74911-9ec7-4d46-b689-ab5ae0cbb567),segment_id=e2f74911-9ec7-4d46-b689-ab5ae0cbb567)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:46:04.111357 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-fed4769b-0147-45cd-8c56-2425b42dfa69 req-e311c58a-9b74-458b-9b4a-09ab40ef103d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:04.124693 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-fed4769b-0147-45cd-8c56-2425b42dfa69 req-e311c58a-9b74-458b-9b4a-09ab40ef103d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Calling delete_port for 15210d7b-a185-432f-9885-014d180eb6b9 owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:46:04.260877 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-fed4769b-0147-45cd-8c56-2425b42dfa69 req-e311c58a-9b74-458b-9b4a-09ab40ef103d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:04.275525 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['15210d7b-a185-432f-9885-014d180eb6b9'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:46:04.288954 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e311c58a-9b74-458b-9b4a-09ab40ef103d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Pushing event deleted for resources: {'Port': ['ID=15210d7b-a185-432f-9885-014d180eb6b9,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:04.329611 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-fed4769b-0147-45cd-8c56-2425b42dfa69 req-e311c58a-9b74-458b-9b4a-09ab40ef103d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] No DVR routers for this DVR port 15210d7b-a185-432f-9885-014d180eb6b9 on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:46:04.332340 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-fed4769b-0147-45cd-8c56-2425b42dfa69 req-e311c58a-9b74-458b-9b4a-09ab40ef103d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:04.335644 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fed4769b-0147-45cd-8c56-2425b42dfa69 req-e311c58a-9b74-458b-9b4a-09ab40ef103d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.44 "DELETE /v2.0/ports/15210d7b-a185-432f-9885-014d180eb6b9 HTTP/1.1" status: 204 len: 173 time: 0.4120481 Dec 09 14:46:04.336085 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd798c281-d19b-4602-8aea-7542278bcd34', 'name': 'network-vif-deleted', 'tag': '15210d7b-a185-432f-9885-014d180eb6b9'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:46:04.338340 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0abae89d-0de0-48c7-95df-96651f4f225f" -d '{"events": [{"server_uuid": "d798c281-d19b-4602-8aea-7542278bcd34", "name": "network-vif-deleted", "tag": "15210d7b-a185-432f-9885-014d180eb6b9"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:46:04.377645 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:46:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-db21eee1-c87f-42a2-acd6-92893c3ab6de x-openstack-request-id: req-db21eee1-c87f-42a2-acd6-92893c3ab6de {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:46:04.377944 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d798c281-d19b-4602-8aea-7542278bcd34", "name": "network-vif-deleted", "tag": "15210d7b-a185-432f-9885-014d180eb6b9", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:46:04.378204 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-db21eee1-c87f-42a2-acd6-92893c3ab6de {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:46:04.378630 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd798c281-d19b-4602-8aea-7542278bcd34', 'name': 'network-vif-deleted', 'tag': '15210d7b-a185-432f-9885-014d180eb6b9', 'status': 'completed', 'code': 200} Dec 09 14:46:04.660957 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0e8ad0f8-43c7-4110-a52d-5b900af0d06a req-40968a70-45ea-41d3-a42b-549651fb9734 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 210 time: 0.0371587 Dec 09 14:46:04.779865 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-866fb711-c451-4d54-a334-0fb33c3c908c tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:04.781348 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-866fb711-c451-4d54-a334-0fb33c3c908c tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.44 "GET /v2.0/networks?id=ec211a40-6211-48b6-8014-deb1231b8f8a HTTP/1.1" status: 200 len: 815 time: 0.1402194 Dec 09 14:46:04.789726 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae99cb5a-e321-47ef-8f15-9e4de05f18b7 req-6e1dbc81-a23e-42d9-a873-8f5539cafed3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:04.791054 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ae99cb5a-e321-47ef-8f15-9e4de05f18b7 req-6e1dbc81-a23e-42d9-a873-8f5539cafed3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0838528 Dec 09 14:46:04.815829 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-3a894e6b-9c89-4391-a42d-85c4b95069a7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Request body: {'port': {'device_id': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'admin_state_up': True, 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:46:04.892163 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ae99cb5a-e321-47ef-8f15-9e4de05f18b7 req-ae009afa-0a5e-4965-b0bd-af84a79e8dbd tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0949519 Dec 09 14:46:04.921791 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0858b561-e34f-4755-aab6-b7efc74e0b1f req-6f9d74c3-1009-4e03-a41e-b6d9783fd6f1 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=d798c281-d19b-4602-8aea-7542278bcd34 HTTP/1.1" status: 200 len: 210 time: 0.0262921 Dec 09 14:46:04.952143 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-3a894e6b-9c89-4391-a42d-85c4b95069a7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Made reservation on behalf of ed13d07c829a42dca57ff23f7538ecda for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:46:04.955997 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-3a894e6b-9c89-4391-a42d-85c4b95069a7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:05.086395 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-3a894e6b-9c89-4391-a42d-85c4b95069a7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Allocated IP 172.20.0.4 (ec211a40-6211-48b6-8014-deb1231b8f8a/3e261ed3-068f-4b13-8a79-5f90048fcbe6/0033cc00-709a-496e-9a3b-1837dafd79dd) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:46:05.288630 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-3a894e6b-9c89-4391-a42d-85c4b95069a7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:05.334917 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-3a894e6b-9c89-4391-a42d-85c4b95069a7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:05.383807 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-3a894e6b-9c89-4391-a42d-85c4b95069a7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Network ec211a40-6211-48b6-8014-deb1231b8f8a is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:46:05.391433 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-3a894e6b-9c89-4391-a42d-85c4b95069a7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:46:05.396210 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-3a894e6b-9c89-4391-a42d-85c4b95069a7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:46:05.400651 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a894e6b-9c89-4391-a42d-85c4b95069a7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Pushing event updated for resources: {'Port': ['ID=0033cc00-709a-496e-9a3b-1837dafd79dd,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:05.473474 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-3a894e6b-9c89-4391-a42d-85c4b95069a7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:05.474154 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-3a894e6b-9c89-4391-a42d-85c4b95069a7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:05.492246 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-3a894e6b-9c89-4391-a42d-85c4b95069a7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6816540 Dec 09 14:46:05.711757 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-eb8cde56-8890-4694-b0ca-70e149e76c74 None None] Provisioning complete for port 0033cc00-709a-496e-9a3b-1837dafd79dd triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:46:05.712292 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-eb8cde56-8890-4694-b0ca-70e149e76c74 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:05.756818 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-eb8cde56-8890-4694-b0ca-70e149e76c74 None None] Port 0033cc00-709a-496e-9a3b-1837dafd79dd cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:46:05.789505 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12068ce9-d1de-4968-a250-6f545f71a9fc req-bb8b4f26-9325-471f-bbe3-b04f0190355c tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:05.791031 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-12068ce9-d1de-4968-a250-6f545f71a9fc req-bb8b4f26-9325-471f-bbe3-b04f0190355c tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 931 time: 0.0516605 Dec 09 14:46:05.839861 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-12068ce9-d1de-4968-a250-6f545f71a9fc req-22fccb35-4afb-4947-9a36-000c5f133cde tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425944 Dec 09 14:46:06.013701 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07210e50-cd26-46a1-842c-db7c55dd9afe req-179365af-4009-4105-9164-0d7cb5cdbe21 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:06.015229 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-07210e50-cd26-46a1-842c-db7c55dd9afe req-179365af-4009-4105-9164-0d7cb5cdbe21 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0523155 Dec 09 14:46:06.067876 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-07210e50-cd26-46a1-842c-db7c55dd9afe req-78068d4f-f3b6-4290-a126-8ae888011cf9 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461175 Dec 09 14:46:06.969575 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02bc7111-c71e-46e2-a300-21a584837767 req-286d7d77-2ec6-4c2b-b6cc-312e0822d471 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:06.970961 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-02bc7111-c71e-46e2-a300-21a584837767 req-286d7d77-2ec6-4c2b-b6cc-312e0822d471 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 931 time: 0.0492144 Dec 09 14:46:07.021749 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-02bc7111-c71e-46e2-a300-21a584837767 req-9e4d3434-f21d-45e4-b119-d71684747148 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444343 Dec 09 14:46:07.192964 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a5d0df-e8e3-4d9f-a57b-b0b6a2acbeac req-cc004350-b1fa-48b9-90b7-b8ad5eeec210 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:07.194509 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b8a5d0df-e8e3-4d9f-a57b-b0b6a2acbeac req-cc004350-b1fa-48b9-90b7-b8ad5eeec210 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0510595 Dec 09 14:46:07.244874 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b8a5d0df-e8e3-4d9f-a57b-b0b6a2acbeac req-0af22a97-bde4-406a-b160-4087c651fd97 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0440869 Dec 09 14:46:07.701031 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 15210d7b-a185-432f-9885-014d180eb6b9 no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:46:07.731896 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: 15210d7b-a185-432f-9885-014d180eb6b9 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:46:07.732218 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 15210d7b-a185-432f-9885-014d180eb6b9 not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:46:08.145283 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c233c957-154a-4d69-834e-3900b7c0c234 req-0cb59bde-7ca8-4656-bc7c-964e68ac0b59 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:08.146858 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c233c957-154a-4d69-834e-3900b7c0c234 req-0cb59bde-7ca8-4656-bc7c-964e68ac0b59 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 931 time: 0.0542409 Dec 09 14:46:08.195004 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c233c957-154a-4d69-834e-3900b7c0c234 req-c410d8e4-983a-4d8b-a89c-6cd122315f9e tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417857 Dec 09 14:46:08.372362 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebd38672-34b6-4b6e-ba5d-8976d8ec5525 req-48acb419-7e88-43be-bc6c-65267ba61d85 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:08.373839 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ebd38672-34b6-4b6e-ba5d-8976d8ec5525 req-48acb419-7e88-43be-bc6c-65267ba61d85 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0504143 Dec 09 14:46:08.420303 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ebd38672-34b6-4b6e-ba5d-8976d8ec5525 req-7f7d350e-87fc-4697-88a0-f0940770768a tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403342 Dec 09 14:46:09.318369 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-464f3fc4-d120-4dc5-93d5-0251afd0b72a req-f7894695-643f-4e38-b94f-c8cd9d29a5e5 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:09.320016 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-464f3fc4-d120-4dc5-93d5-0251afd0b72a req-f7894695-643f-4e38-b94f-c8cd9d29a5e5 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 931 time: 0.0550451 Dec 09 14:46:09.367359 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-464f3fc4-d120-4dc5-93d5-0251afd0b72a req-c6cb4713-e17b-4992-9082-fb71756c1998 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411842 Dec 09 14:46:09.564839 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0eb9099-ba77-4023-be07-3a6f34e7d6af req-844d42b3-d174-496a-9202-ea884e7772de tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:09.566230 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e0eb9099-ba77-4023-be07-3a6f34e7d6af req-844d42b3-d174-496a-9202-ea884e7772de tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0553312 Dec 09 14:46:09.614590 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e0eb9099-ba77-4023-be07-3a6f34e7d6af req-fd9c3b90-ef74-4962-96eb-3ca59aa7f373 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423017 Dec 09 14:46:10.504077 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5462de0b-1887-45cc-ba6f-40ce26100273 req-1c6d6440-b191-417c-8500-60b8d23fce48 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:10.505490 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5462de0b-1887-45cc-ba6f-40ce26100273 req-1c6d6440-b191-417c-8500-60b8d23fce48 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 931 time: 0.0548875 Dec 09 14:46:10.552234 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5462de0b-1887-45cc-ba6f-40ce26100273 req-5503c0f3-1159-4870-909d-bc540b115374 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405877 Dec 09 14:46:10.751001 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74d28c7e-fc22-44d7-a0f6-b6d36d82dc7d req-47ac9be3-1056-454f-8a4b-3efa06a04682 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:10.752643 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-74d28c7e-fc22-44d7-a0f6-b6d36d82dc7d req-47ac9be3-1056-454f-8a4b-3efa06a04682 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0579531 Dec 09 14:46:10.801931 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-74d28c7e-fc22-44d7-a0f6-b6d36d82dc7d req-5d6eca92-62ff-4598-985b-f955a23c2a63 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429528 Dec 09 14:46:11.670046 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3c34967-bc3e-4d4a-8ea4-138168fb60c3 req-5255028c-7ad9-4f9f-94b4-ad052ad91d85 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:11.672394 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c3c34967-bc3e-4d4a-8ea4-138168fb60c3 req-5255028c-7ad9-4f9f-94b4-ad052ad91d85 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 931 time: 0.0495141 Dec 09 14:46:11.740240 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c3c34967-bc3e-4d4a-8ea4-138168fb60c3 req-24c30dc1-a971-48fa-b9da-646acf14ec71 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612435 Dec 09 14:46:11.918112 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aa7e330-0d66-4a84-8906-c8a002a3d9f8 req-e9c630ce-c430-40b3-9425-c15633b0b408 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:11.919558 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5aa7e330-0d66-4a84-8906-c8a002a3d9f8 req-e9c630ce-c430-40b3-9425-c15633b0b408 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0502753 Dec 09 14:46:11.972626 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5aa7e330-0d66-4a84-8906-c8a002a3d9f8 req-c2d7114f-a11e-438d-8d99-ebca1d2b8416 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442088 Dec 09 14:46:12.858212 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687d92c5-0f8a-4ee7-9b44-4bf8dfb79d6a req-1b87a4a4-7dda-43d6-8b3e-152749703837 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:12.859700 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-687d92c5-0f8a-4ee7-9b44-4bf8dfb79d6a req-1b87a4a4-7dda-43d6-8b3e-152749703837 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 931 time: 0.0485723 Dec 09 14:46:12.912320 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-687d92c5-0f8a-4ee7-9b44-4bf8dfb79d6a req-256e788e-f630-4056-8d7c-021f3d580e3d tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466249 Dec 09 14:46:13.102079 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-403b137c-0980-4acf-aa4c-6d5784e2bcd2 req-1937b073-70bb-4c9e-9512-613306bf9fb8 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:13.103640 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-403b137c-0980-4acf-aa4c-6d5784e2bcd2 req-1937b073-70bb-4c9e-9512-613306bf9fb8 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0509477 Dec 09 14:46:13.153025 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-403b137c-0980-4acf-aa4c-6d5784e2bcd2 req-d6678b53-81f0-4687-aaaa-ecb7a1ec1c62 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411556 Dec 09 14:46:14.040222 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a908b7-e097-42ea-a504-97b7e11be5d0 req-01f2085b-757d-40c9-a412-37676b8870fe tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:14.041703 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-32a908b7-e097-42ea-a504-97b7e11be5d0 req-01f2085b-757d-40c9-a412-37676b8870fe tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 931 time: 0.0511539 Dec 09 14:46:14.093501 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-32a908b7-e097-42ea-a504-97b7e11be5d0 req-085b4e55-fd4a-4a0c-87fe-96c847e6f405 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428059 Dec 09 14:46:14.293039 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d2e6810-c87d-43d7-846e-28abdb83d565 req-d386d02a-0523-41a5-bd00-8712e3aabc06 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:14.294624 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8d2e6810-c87d-43d7-846e-28abdb83d565 req-d386d02a-0523-41a5-bd00-8712e3aabc06 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0575180 Dec 09 14:46:14.347291 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8d2e6810-c87d-43d7-846e-28abdb83d565 req-270157f1-8540-48af-b3f0-d9e20f9123c3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457730 Dec 09 14:46:14.808283 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:15.209663 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-631fccdd-5312-473e-a4ea-51324f8c5bc1 req-4abd4b9d-c0aa-4aac-884a-51d4e373781c tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:15.213551 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-631fccdd-5312-473e-a4ea-51324f8c5bc1 req-4abd4b9d-c0aa-4aac-884a-51d4e373781c tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 931 time: 0.0516174 Dec 09 14:46:15.269682 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-631fccdd-5312-473e-a4ea-51324f8c5bc1 req-04d620c2-0a56-4a40-aec9-904022f813bc tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512185 Dec 09 14:46:15.710790 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36eda949-8e9d-4cba-bc37-229c9262fd16 req-84e86ee1-2fe5-4df3-aa8b-9ff96942d3bb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:15.712375 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-36eda949-8e9d-4cba-bc37-229c9262fd16 req-84e86ee1-2fe5-4df3-aa8b-9ff96942d3bb tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.2853684 Dec 09 14:46:15.759941 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-36eda949-8e9d-4cba-bc37-229c9262fd16 req-3c13068c-1ba7-42cc-a012-2e437acbeaf6 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410962 Dec 09 14:46:16.395191 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-565128e2-dbb7-4f36-8735-b5d7edb79ecc req-2fec04ab-3309-4589-83b0-f6a4a5e223cd tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:16.396665 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-565128e2-dbb7-4f36-8735-b5d7edb79ecc req-2fec04ab-3309-4589-83b0-f6a4a5e223cd tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 931 time: 0.0524211 Dec 09 14:46:16.443807 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-565128e2-dbb7-4f36-8735-b5d7edb79ecc req-9ff8d6d2-3464-4bfa-902d-c66877ad79d6 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411284 Dec 09 14:46:16.885297 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76e15312-b7cc-4685-b7c2-fce477a861e4 req-de7b9b90-8e5f-41c4-b740-b21c6ca6cf9c tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:16.887116 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-76e15312-b7cc-4685-b7c2-fce477a861e4 req-de7b9b90-8e5f-41c4-b740-b21c6ca6cf9c tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0522583 Dec 09 14:46:16.936834 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-76e15312-b7cc-4685-b7c2-fce477a861e4 req-80179535-954a-4ebd-aba6-603e158d1b6e tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432680 Dec 09 14:46:17.561469 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a09d9f7-c313-4f10-8f6a-1f8da368d695 req-8e2cab90-29a2-4def-a7e1-1f6432220b68 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:17.562965 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3a09d9f7-c313-4f10-8f6a-1f8da368d695 req-8e2cab90-29a2-4def-a7e1-1f6432220b68 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 931 time: 0.0491745 Dec 09 14:46:17.613202 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3a09d9f7-c313-4f10-8f6a-1f8da368d695 req-9dcba9b0-ec38-4dad-84fc-63add9a49440 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441139 Dec 09 14:46:18.032585 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-d30239ff-ee33-44bb-bf30-f824e883fccf tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:18.034170 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-d30239ff-ee33-44bb-bf30-f824e883fccf tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/networks?id=8ae9a24a-645d-43a9-b32c-41629b26c09e HTTP/1.1" status: 200 len: 814 time: 0.1109397 Dec 09 14:46:18.050047 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-5fcd281d-84e2-42a1-88a2-a554fde89f3c tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/quotas/3b3199edde77497bbdb703336ce72b78 HTTP/1.1" status: 200 len: 375 time: 0.0100784 Dec 09 14:46:18.053242 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8304959-6b86-429e-92fc-8ae9b70c24f1 req-c893ed6a-dbc5-4fbd-89cb-9d33c562e1f5 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:18.055152 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a8304959-6b86-429e-92fc-8ae9b70c24f1 req-c893ed6a-dbc5-4fbd-89cb-9d33c562e1f5 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0495842 Dec 09 14:46:18.082665 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-d5e5fa54-58e2-4872-8b84-c51f78f0f7ca tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=3b3199edde77497bbdb703336ce72b78&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0263672 Dec 09 14:46:18.181284 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-543ebaf5-62ab-4cad-b17b-6e2ae5429cee service neutron] 10.222.0.39 "GET /v2.0/networks/8ae9a24a-645d-43a9-b32c-41629b26c09e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0915747 Dec 09 14:46:18.275590 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-4b99fbda-28c5-4300-9c8a-a7d838b3db5c service neutron] 10.222.0.39 "GET /v2.0/networks/8ae9a24a-645d-43a9-b32c-41629b26c09e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0877690 Dec 09 14:46:18.353614 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a8304959-6b86-429e-92fc-8ae9b70c24f1 req-96a20484-65c3-42a7-a7fb-1719be1c7428 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2924685 Dec 09 14:46:18.451712 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c8967d7b-ddec-40fd-a92d-9d70d663501e req-cfa8150e-ac6a-4266-b0f2-fc781970e095 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 210 time: 0.0267570 Dec 09 14:46:18.761460 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cf400d1-a112-46ce-8204-2a0f18b603e4 req-7d748a48-a5f2-4941-8ca3-37a4d3d56f44 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:18.766473 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6cf400d1-a112-46ce-8204-2a0f18b603e4 req-7d748a48-a5f2-4941-8ca3-37a4d3d56f44 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 931 time: 0.0787511 Dec 09 14:46:18.826962 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6cf400d1-a112-46ce-8204-2a0f18b603e4 req-f9069451-2653-4341-b31b-1bbb8b5f8117 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535269 Dec 09 14:46:19.493362 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6bee002c-64f8-453c-8552-7fbf6d796dd0 req-604f62be-9c4f-45ac-b77b-32bc74c8c0ba tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:19.495338 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6bee002c-64f8-453c-8552-7fbf6d796dd0 req-604f62be-9c4f-45ac-b77b-32bc74c8c0ba tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0540495 Dec 09 14:46:19.542916 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6bee002c-64f8-453c-8552-7fbf6d796dd0 req-3a5048d1-c8ca-4aaf-89af-17f8147ec5fd tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414538 Dec 09 14:46:19.543148 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8d7c0893-392b-4e2b-adcd-034ad06791c7 req-a6897e21-22bc-4598-9ff3-c98f5dd0c974 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 210 time: 0.0248327 Dec 09 14:46:19.726603 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Request body: {'port': {'device_id': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:46:19.784327 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:19.945665 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57030a5b-be38-4834-868d-7c810f43c21e req-c29d6248-894c-42db-ad64-59f6eaf115e5 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:19.947153 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-57030a5b-be38-4834-868d-7c810f43c21e req-c29d6248-894c-42db-ad64-59f6eaf115e5 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 931 time: 0.0520861 Dec 09 14:46:19.997737 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-57030a5b-be38-4834-868d-7c810f43c21e req-045a947f-6573-4689-8aeb-e4077e407fb2 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441523 Dec 09 14:46:20.050801 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0033cc00-709a-496e-9a3b-1837dafd79dd {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:46:20.058611 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:20.070941 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Transition to ACTIVE for port object 0033cc00-709a-496e-9a3b-1837dafd79dd will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:46:20.076595 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:20.124607 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Pushing event updated for resources: {'Port': ['ID=0033cc00-709a-496e-9a3b-1837dafd79dd,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:20.198285 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Attempting to bind port 0033cc00-709a-496e-9a3b-1837dafd79dd on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:46:20.198661 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Attempting to bind port 0033cc00-709a-496e-9a3b-1837dafd79dd by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': 'd8b4a507-9bfc-4567-82ac-77b20844733a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:46:20.199449 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Attempting to bind port 0033cc00-709a-496e-9a3b-1837dafd79dd on network ec211a40-6211-48b6-8014-deb1231b8f8a {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:46:20.204643 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Port 0033cc00-709a-496e-9a3b-1837dafd79dd on network ec211a40-6211-48b6-8014-deb1231b8f8a not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:46:20.204976 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Attempting to bind port 0033cc00-709a-496e-9a3b-1837dafd79dd on network ec211a40-6211-48b6-8014-deb1231b8f8a {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:46:20.209976 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 46, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:46:20.210323 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Checking segment: {'id': 'd8b4a507-9bfc-4567-82ac-77b20844733a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:46:20.210713 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Bound using segment: {'id': 'd8b4a507-9bfc-4567-82ac-77b20844733a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:46:20.211148 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Bound port: 0033cc00-709a-496e-9a3b-1837dafd79dd, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8b4a507-9bfc-4567-82ac-77b20844733a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 426, 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:46:20.211515 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:20.277225 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] For port 0033cc00-709a-496e-9a3b-1837dafd79dd, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:46:20.280523 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] For port 0033cc00-709a-496e-9a3b-1837dafd79dd, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0033cc00-709a-496e-9a3b-1837dafd79dd,segment=NetworkSegment(d8b4a507-9bfc-4567-82ac-77b20844733a),segment_id=d8b4a507-9bfc-4567-82ac-77b20844733a)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:46:20.286084 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:20.321420 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:20.322330 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:20.323949 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] 10.222.0.44 "PUT /v2.0/ports/0033cc00-709a-496e-9a3b-1837dafd79dd HTTP/1.1" status: 200 len: 1093 time: 0.6034734 Dec 09 14:46:20.324397 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'tag': '0033cc00-709a-496e-9a3b-1837dafd79dd'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:46:20.326752 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-acb68142-5bb7-4d44-81fb-d619259c74d5" -d '{"events": [{"name": "network-changed", "server_uuid": "1556759d-80fc-4a03-accf-81a2ffccc9d1", "tag": "0033cc00-709a-496e-9a3b-1837dafd79dd"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:46:20.405006 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:46:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ddc02946-e8d8-4e91-ad5b-deebf737669b x-openstack-request-id: req-ddc02946-e8d8-4e91-ad5b-deebf737669b {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:46:20.405338 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1556759d-80fc-4a03-accf-81a2ffccc9d1", "tag": "0033cc00-709a-496e-9a3b-1837dafd79dd", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:46:20.405642 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-ddc02946-e8d8-4e91-ad5b-deebf737669b {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:46:20.406075 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'tag': '0033cc00-709a-496e-9a3b-1837dafd79dd', 'status': 'completed', 'code': 200} Dec 09 14:46:20.441785 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c75ddea4-1aad-4512-b75f-782ea9141744 service neutron] Pushing event updated for resources: {'Port': ['ID=0033cc00-709a-496e-9a3b-1837dafd79dd,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:20.496357 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-f7486e68-81c6-40e2-8166-4ce716bacce2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:20.498144 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-f7486e68-81c6-40e2-8166-4ce716bacce2 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=ed13d07c829a42dca57ff23f7538ecda&device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 1096 time: 0.0890558 Dec 09 14:46:20.506839 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-5868ae33-83d9-440a-9e67-ec55623afba9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:20.508769 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-5868ae33-83d9-440a-9e67-ec55623afba9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.44 "GET /v2.0/networks?id=8ae9a24a-645d-43a9-b32c-41629b26c09e HTTP/1.1" status: 200 len: 814 time: 0.1663470 Dec 09 14:46:20.552537 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-49f86eae-2707-4793-b269-910f5027a5e9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Request body: {'port': {'device_id': '7cee90e4-4ab9-4ff3-865b-7c84761d82c9', 'network_id': '8ae9a24a-645d-43a9-b32c-41629b26c09e', 'admin_state_up': True, 'tenant_id': '3b3199edde77497bbdb703336ce72b78'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:46:20.556371 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-0c1f887f-3e35-477b-9528-84f5cbcb38c1 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=0033cc00-709a-496e-9a3b-1837dafd79dd HTTP/1.1" status: 200 len: 217 time: 0.0467064 Dec 09 14:46:20.665460 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54eeee69-a310-4485-9c0c-48ee9aa838e7 req-5da12317-8d7b-475a-b764-caebcf25d454 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:20.667082 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-54eeee69-a310-4485-9c0c-48ee9aa838e7 req-5da12317-8d7b-475a-b764-caebcf25d454 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0501559 Dec 09 14:46:20.671769 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e0dadd9e-35b6-4b6e-9b5d-d9c8c079a060 req-8c8cd576-7eba-466b-aaed-4be48b8c9839 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 210 time: 0.0474479 Dec 09 14:46:20.680667 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-ed1003b2-2f58-401e-b8e7-6fc9c7c5a56e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:20.682081 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-ed1003b2-2f58-401e-b8e7-6fc9c7c5a56e service neutron] 10.222.0.44 "GET /v2.0/subnets?id=3e261ed3-068f-4b13-8a79-5f90048fcbe6 HTTP/1.1" status: 200 len: 854 time: 0.1138289 Dec 09 14:46:20.719547 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-54eeee69-a310-4485-9c0c-48ee9aa838e7 req-867317b1-8a7c-4d3d-ab02-219a9ea0aa32 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459526 Dec 09 14:46:20.763272 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-bf2b72c6-a0f0-4f3e-84d9-d6031248feab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:20.764843 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-bf2b72c6-a0f0-4f3e-84d9-d6031248feab service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=ec211a40-6211-48b6-8014-deb1231b8f8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0565169 Dec 09 14:46:20.765575 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-49f86eae-2707-4793-b269-910f5027a5e9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Made reservation on behalf of 3b3199edde77497bbdb703336ce72b78 for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:46:20.769011 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-49f86eae-2707-4793-b269-910f5027a5e9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:20.932314 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-8835c98a-bc5e-4e87-b348-a886d4f932b8 service neutron] 10.222.0.44 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1542161 Dec 09 14:46:20.997631 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-49f86eae-2707-4793-b269-910f5027a5e9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Allocated IP 172.20.0.5 (8ae9a24a-645d-43a9-b32c-41629b26c09e/a44bb60f-825d-4a27-a5af-fbe9e6e78fb7/0f2f1781-649a-4354-970b-2a44213cf1b4) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:46:21.109313 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-36dd88ba-17b7-4e6a-aed8-9646c36da33d req-6205c9d5-d013-4740-a9fd-b3472615fd84 service neutron] 10.222.0.44 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1660552 Dec 09 14:46:21.204083 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-850a0fdd-a671-4aaf-b06a-c445c21c364a req-940959d0-496e-48f0-ab83-d481c311020c tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:21.205483 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-850a0fdd-a671-4aaf-b06a-c445c21c364a req-940959d0-496e-48f0-ab83-d481c311020c tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 943 time: 0.1415489 Dec 09 14:46:21.267715 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acb68142-5bb7-4d44-81fb-d619259c74d5 req-13bccea0-6aed-40c4-8235-b2b627ff1ab0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:21.269229 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-acb68142-5bb7-4d44-81fb-d619259c74d5 req-13bccea0-6aed-40c4-8235-b2b627ff1ab0 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=ed13d07c829a42dca57ff23f7538ecda&device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 1096 time: 0.1065230 Dec 09 14:46:21.277636 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-49f86eae-2707-4793-b269-910f5027a5e9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:21.316084 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-850a0fdd-a671-4aaf-b06a-c445c21c364a req-fe312c2f-f7e2-4586-a319-8b85fd9fbad4 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0968907 Dec 09 14:46:21.391343 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-49f86eae-2707-4793-b269-910f5027a5e9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:21.437015 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acb68142-5bb7-4d44-81fb-d619259c74d5 req-582176e0-6613-4a08-a1da-dcbadd15071f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:21.438525 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-acb68142-5bb7-4d44-81fb-d619259c74d5 req-582176e0-6613-4a08-a1da-dcbadd15071f service neutron] 10.222.0.44 "GET /v2.0/networks?id=ec211a40-6211-48b6-8014-deb1231b8f8a HTTP/1.1" status: 200 len: 916 time: 0.1564291 Dec 09 14:46:21.454462 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-49f86eae-2707-4793-b269-910f5027a5e9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Network 8ae9a24a-645d-43a9-b32c-41629b26c09e is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:46:21.466447 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-49f86eae-2707-4793-b269-910f5027a5e9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:46:21.496859 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-49f86eae-2707-4793-b269-910f5027a5e9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:46:21.499631 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49f86eae-2707-4793-b269-910f5027a5e9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Pushing event updated for resources: {'Port': ['ID=0f2f1781-649a-4354-970b-2a44213cf1b4,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:21.502516 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-acb68142-5bb7-4d44-81fb-d619259c74d5 req-c806ad07-0a47-4722-bb6d-c715bc93a134 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=0033cc00-709a-496e-9a3b-1837dafd79dd HTTP/1.1" status: 200 len: 217 time: 0.0454288 Dec 09 14:46:21.574904 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-49f86eae-2707-4793-b269-910f5027a5e9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:21.575534 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-49f86eae-2707-4793-b269-910f5027a5e9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:21.588818 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acb68142-5bb7-4d44-81fb-d619259c74d5 req-d7887750-8827-41a0-8594-eabde881685a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:21.590225 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-acb68142-5bb7-4d44-81fb-d619259c74d5 req-d7887750-8827-41a0-8594-eabde881685a service neutron] 10.222.0.44 "GET /v2.0/subnets?id=3e261ed3-068f-4b13-8a79-5f90048fcbe6 HTTP/1.1" status: 200 len: 854 time: 0.0682569 Dec 09 14:46:21.603329 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-49f86eae-2707-4793-b269-910f5027a5e9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0549209 Dec 09 14:46:21.631921 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Request body: {'port': {'device_id': '7cee90e4-4ab9-4ff3-865b-7c84761d82c9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:46:21.696319 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acb68142-5bb7-4d44-81fb-d619259c74d5 req-4d1f8f56-e0b7-4a3d-ae79-32b953fcd198 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:21.697900 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-acb68142-5bb7-4d44-81fb-d619259c74d5 req-4d1f8f56-e0b7-4a3d-ae79-32b953fcd198 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=ec211a40-6211-48b6-8014-deb1231b8f8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0984802 Dec 09 14:46:21.698966 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:21.791018 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ede9e58-6ce1-4fab-9a48-1b037a4a8d32 req-5c848d2e-2aa2-42b7-9ba8-cfbe1e541ac9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:21.792915 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3ede9e58-6ce1-4fab-9a48-1b037a4a8d32 req-5c848d2e-2aa2-42b7-9ba8-cfbe1e541ac9 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 931 time: 0.0505331 Dec 09 14:46:21.840230 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3ede9e58-6ce1-4fab-9a48-1b037a4a8d32 req-37aca095-e9cd-40be-876a-14343ded616c tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414736 Dec 09 14:46:21.913971 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-acb68142-5bb7-4d44-81fb-d619259c74d5 req-8437490f-5bd0-4f9a-8e11-cd2144e93812 service neutron] 10.222.0.44 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2059364 Dec 09 14:46:21.949851 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e614b24-6df1-40ab-b4af-31aa8cdb767b req-18938d53-f339-47f6-a01c-648c1a0651e8 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:21.951337 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8e614b24-6df1-40ab-b4af-31aa8cdb767b req-18938d53-f339-47f6-a01c-648c1a0651e8 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.1569161 Dec 09 14:46:22.114252 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8e614b24-6df1-40ab-b4af-31aa8cdb767b req-ad546a23-fc3e-437e-bb25-f7fc924c8380 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1350608 Dec 09 14:46:22.129567 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-acb68142-5bb7-4d44-81fb-d619259c74d5 req-ddde5ff0-df6e-48ab-acf2-401670a8ed10 service neutron] 10.222.0.44 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2042139 Dec 09 14:46:22.181015 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0f2f1781-649a-4354-970b-2a44213cf1b4 {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:46:22.189270 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:22.202536 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Transition to ACTIVE for port object 0f2f1781-649a-4354-970b-2a44213cf1b4 will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:46:22.209397 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:22.258555 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Pushing event updated for resources: {'Port': ['ID=0f2f1781-649a-4354-970b-2a44213cf1b4,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:22.330191 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Attempting to bind port 0f2f1781-649a-4354-970b-2a44213cf1b4 on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:46:22.330555 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Attempting to bind port 0f2f1781-649a-4354-970b-2a44213cf1b4 by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': 'e2f74911-9ec7-4d46-b689-ab5ae0cbb567', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 421, 'network_id': '8ae9a24a-645d-43a9-b32c-41629b26c09e'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:46:22.330889 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Attempting to bind port 0f2f1781-649a-4354-970b-2a44213cf1b4 on network 8ae9a24a-645d-43a9-b32c-41629b26c09e {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:46:22.335798 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Port 0f2f1781-649a-4354-970b-2a44213cf1b4 on network 8ae9a24a-645d-43a9-b32c-41629b26c09e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:46:22.336209 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Attempting to bind port 0f2f1781-649a-4354-970b-2a44213cf1b4 on network 8ae9a24a-645d-43a9-b32c-41629b26c09e {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:46:22.341947 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 46, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:46:22.342300 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Checking segment: {'id': 'e2f74911-9ec7-4d46-b689-ab5ae0cbb567', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 421, 'network_id': '8ae9a24a-645d-43a9-b32c-41629b26c09e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:46:22.342688 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Bound using segment: {'id': 'e2f74911-9ec7-4d46-b689-ab5ae0cbb567', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 421, 'network_id': '8ae9a24a-645d-43a9-b32c-41629b26c09e'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:46:22.343119 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Bound port: 0f2f1781-649a-4354-970b-2a44213cf1b4, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e2f74911-9ec7-4d46-b689-ab5ae0cbb567', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 421, 'network_id': '8ae9a24a-645d-43a9-b32c-41629b26c09e'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:46:22.343480 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:22.408092 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] For port 0f2f1781-649a-4354-970b-2a44213cf1b4, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:46:22.411102 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] For port 0f2f1781-649a-4354-970b-2a44213cf1b4, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0f2f1781-649a-4354-970b-2a44213cf1b4,segment=NetworkSegment(e2f74911-9ec7-4d46-b689-ab5ae0cbb567),segment_id=e2f74911-9ec7-4d46-b689-ab5ae0cbb567)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:46:22.416963 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:22.429019 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b29d5b87-b330-45af-9a80-335d5504f4a4 req-63e41208-66b6-4053-8dc4-c28c33419f80 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:22.430600 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b29d5b87-b330-45af-9a80-335d5504f4a4 req-63e41208-66b6-4053-8dc4-c28c33419f80 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 943 time: 0.0480404 Dec 09 14:46:22.452355 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:22.453162 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:22.454593 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] 10.222.0.44 "PUT /v2.0/ports/0f2f1781-649a-4354-970b-2a44213cf1b4 HTTP/1.1" status: 200 len: 1093 time: 0.8267720 Dec 09 14:46:22.455057 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7cee90e4-4ab9-4ff3-865b-7c84761d82c9', 'tag': '0f2f1781-649a-4354-970b-2a44213cf1b4'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:46:22.457343 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cfa9cb97-eb3b-486e-8278-8cc57826c8a2" -d '{"events": [{"name": "network-changed", "server_uuid": "7cee90e4-4ab9-4ff3-865b-7c84761d82c9", "tag": "0f2f1781-649a-4354-970b-2a44213cf1b4"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:46:22.482362 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b29d5b87-b330-45af-9a80-335d5504f4a4 req-05dbbf1f-17bd-417f-991a-60bbb713a5e7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454161 Dec 09 14:46:22.489521 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d0787fa-3d84-46d0-83c3-74c0fe118b4a service neutron] Pushing event updated for resources: {'Port': ['ID=0f2f1781-649a-4354-970b-2a44213cf1b4,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:22.497361 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:46:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9dbfe5f7-c999-47f2-8351-e5d6f7f6f04f x-openstack-request-id: req-9dbfe5f7-c999-47f2-8351-e5d6f7f6f04f {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:46:22.497971 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7cee90e4-4ab9-4ff3-865b-7c84761d82c9", "tag": "0f2f1781-649a-4354-970b-2a44213cf1b4", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:46:22.497971 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-9dbfe5f7-c999-47f2-8351-e5d6f7f6f04f {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:46:22.498334 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7cee90e4-4ab9-4ff3-865b-7c84761d82c9', 'tag': '0f2f1781-649a-4354-970b-2a44213cf1b4', 'status': 'completed', 'code': 200} Dec 09 14:46:22.571406 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-28285614-cb6b-4015-978e-f2fd0f590c04 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:22.572945 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-28285614-cb6b-4015-978e-f2fd0f590c04 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=3b3199edde77497bbdb703336ce72b78&device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 1096 time: 0.0457511 Dec 09 14:46:22.632580 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-7382596e-6b4c-45cf-93bb-701150073ea6 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0f2f1781-649a-4354-970b-2a44213cf1b4 HTTP/1.1" status: 200 len: 217 time: 0.0371873 Dec 09 14:46:22.687780 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-ba760479-c045-44f2-9dc7-55897c44c342 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:22.689770 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-ba760479-c045-44f2-9dc7-55897c44c342 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=a44bb60f-825d-4a27-a5af-fbe9e6e78fb7 HTTP/1.1" status: 200 len: 854 time: 0.0465748 Dec 09 14:46:22.723450 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-6322f6dc-50e4-4e9d-96f6-d02ec8713940 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=8ae9a24a-645d-43a9-b32c-41629b26c09e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0255573 Dec 09 14:46:22.827757 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-2ee0918c-ab42-483c-949c-8e752a175be3 service neutron] 10.222.0.44 "GET /v2.0/networks/8ae9a24a-645d-43a9-b32c-41629b26c09e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0890214 Dec 09 14:46:22.952630 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b8db03b0-35e7-495c-ba80-b01b6265d593 req-d164b26f-b962-4ccd-b6b8-20e735a9ae8b service neutron] 10.222.0.44 "GET /v2.0/networks/8ae9a24a-645d-43a9-b32c-41629b26c09e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1121027 Dec 09 14:46:22.979408 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6dd509a-dccb-4018-8192-e4cdd0f74b4a req-0cecd154-4bcd-4278-93ba-f5f86fe80bbc tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:22.981879 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a6dd509a-dccb-4018-8192-e4cdd0f74b4a req-0cecd154-4bcd-4278-93ba-f5f86fe80bbc tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 943 time: 0.0715806 Dec 09 14:46:23.061170 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a6dd509a-dccb-4018-8192-e4cdd0f74b4a req-5a7e870e-d5d2-4e62-b2ed-b4be9e451693 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0727267 Dec 09 14:46:23.075593 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfa9cb97-eb3b-486e-8278-8cc57826c8a2 req-154337eb-2186-4a87-8956-21ee16aaa9d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:23.077098 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfa9cb97-eb3b-486e-8278-8cc57826c8a2 req-154337eb-2186-4a87-8956-21ee16aaa9d3 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=3b3199edde77497bbdb703336ce72b78&device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 1096 time: 0.0541856 Dec 09 14:46:23.179203 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfa9cb97-eb3b-486e-8278-8cc57826c8a2 req-db549ba0-0fd4-4028-bad8-0a04c5a4e243 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:23.180751 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfa9cb97-eb3b-486e-8278-8cc57826c8a2 req-db549ba0-0fd4-4028-bad8-0a04c5a4e243 service neutron] 10.222.0.44 "GET /v2.0/networks?id=8ae9a24a-645d-43a9-b32c-41629b26c09e HTTP/1.1" status: 200 len: 915 time: 0.0946484 Dec 09 14:46:23.231587 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfa9cb97-eb3b-486e-8278-8cc57826c8a2 req-bc6d3ecb-9749-48ab-b0ab-8e5ed4b74a86 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0f2f1781-649a-4354-970b-2a44213cf1b4 HTTP/1.1" status: 200 len: 217 time: 0.0354531 Dec 09 14:46:23.238634 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7bff93c-c2ae-4e8b-b6e9-3c311fc5bfa7 req-50a5d6a9-a9d7-4a0a-b98f-aa7caee4a58b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:23.240173 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c7bff93c-c2ae-4e8b-b6e9-3c311fc5bfa7 req-50a5d6a9-a9d7-4a0a-b98f-aa7caee4a58b tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0513031 Dec 09 14:46:23.283098 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfa9cb97-eb3b-486e-8278-8cc57826c8a2 req-3339dea5-3b83-4bbc-9f4f-29cd06024793 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:23.284643 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfa9cb97-eb3b-486e-8278-8cc57826c8a2 req-3339dea5-3b83-4bbc-9f4f-29cd06024793 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=a44bb60f-825d-4a27-a5af-fbe9e6e78fb7 HTTP/1.1" status: 200 len: 854 time: 0.0458422 Dec 09 14:46:23.286174 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c7bff93c-c2ae-4e8b-b6e9-3c311fc5bfa7 req-a4ee0215-34c3-4a84-8099-a17ae1a09f3f tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0396972 Dec 09 14:46:23.319057 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfa9cb97-eb3b-486e-8278-8cc57826c8a2 req-e1cf659e-4cb6-427d-a8c4-d94b94f28cfe service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=8ae9a24a-645d-43a9-b32c-41629b26c09e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0249946 Dec 09 14:46:23.344342 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 0033cc00-709a-496e-9a3b-1837dafd79dd details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:46:23.417482 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfa9cb97-eb3b-486e-8278-8cc57826c8a2 req-33cf4e2e-d647-4dc1-8895-fef01c61a1fa service neutron] 10.222.0.44 "GET /v2.0/networks/8ae9a24a-645d-43a9-b32c-41629b26c09e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852220 Dec 09 14:46:23.441404 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 0033cc00-709a-496e-9a3b-1837dafd79dd, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0033cc00-709a-496e-9a3b-1837dafd79dd,segment=NetworkSegment(d8b4a507-9bfc-4567-82ac-77b20844733a),segment_id=d8b4a507-9bfc-4567-82ac-77b20844733a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:46:23.453005 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': '0033cc00-709a-496e-9a3b-1837dafd79dd', 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'port_id': '0033cc00-709a-496e-9a3b-1837dafd79dd', 'mac_address': 'fa:16:3e:dc:db:c4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 426, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:46:23.492598 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:23.505523 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0033cc00-709a-496e-9a3b-1837dafd79dd {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:46:23.509023 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cfa9cb97-eb3b-486e-8278-8cc57826c8a2 req-10c22b30-b787-4968-8445-b051dcfbdd78 service neutron] 10.222.0.44 "GET /v2.0/networks/8ae9a24a-645d-43a9-b32c-41629b26c09e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0829747 Dec 09 14:46:23.525259 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 0033cc00-709a-496e-9a3b-1837dafd79dd, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0033cc00-709a-496e-9a3b-1837dafd79dd,segment=NetworkSegment(d8b4a507-9bfc-4567-82ac-77b20844733a),segment_id=d8b4a507-9bfc-4567-82ac-77b20844733a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:46:23.532058 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:23.580210 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=0033cc00-709a-496e-9a3b-1837dafd79dd,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:23.604807 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f726765e-0e7f-4ed2-b77e-d16b63b8aa80 req-1a5d1039-1648-4746-bb0e-2ed4d51764bf tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:23.606286 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f726765e-0e7f-4ed2-b77e-d16b63b8aa80 req-1a5d1039-1648-4746-bb0e-2ed4d51764bf tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 944 time: 0.0534403 Dec 09 14:46:23.653915 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f726765e-0e7f-4ed2-b77e-d16b63b8aa80 req-171c6ede-ac8a-4edd-a8b8-cee9f65438d5 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413361 Dec 09 14:46:23.932705 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['0033cc00-709a-496e-9a3b-1837dafd79dd'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:46:24.181096 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f21273ba-7997-4d26-aebf-3bcba95715c4 req-5e563154-df96-4ad0-9bff-60680236da28 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:24.182541 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f21273ba-7997-4d26-aebf-3bcba95715c4 req-5e563154-df96-4ad0-9bff-60680236da28 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 943 time: 0.0484567 Dec 09 14:46:24.232016 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f21273ba-7997-4d26-aebf-3bcba95715c4 req-329bcffb-f83c-4ec5-8b97-728474164536 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404134 Dec 09 14:46:24.436639 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37efba7c-bdd5-4c95-a9dc-c83dfbc8e968 req-943bd6ee-390f-424f-8bf1-7b4d22d1f971 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:24.438127 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-37efba7c-bdd5-4c95-a9dc-c83dfbc8e968 req-943bd6ee-390f-424f-8bf1-7b4d22d1f971 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0755794 Dec 09 14:46:24.450306 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a22a105-eeb1-4955-8d7e-0a5c45ffd8fa req-4ca0f645-0a26-4ac6-b7d6-d5aa2bb52e1c tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:24.451679 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2a22a105-eeb1-4955-8d7e-0a5c45ffd8fa req-4ca0f645-0a26-4ac6-b7d6-d5aa2bb52e1c tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.44 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 945 time: 0.0635710 Dec 09 14:46:24.545499 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-37efba7c-bdd5-4c95-a9dc-c83dfbc8e968 req-83431c8e-4b8d-4638-a2d1-b97a64f3e250 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/security-groups?id=4d3151d2-417f-4569-9d44-49489aa9418d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0928340 Dec 09 14:46:24.575210 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-2a22a105-eeb1-4955-8d7e-0a5c45ffd8fa req-0e9195fd-5a27-4141-9c14-4bbe0cfbd6dd tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Deleting port bb290a6d-709a-49d1-bd2e-10c0fe664657 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:46:24.575557 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-2a22a105-eeb1-4955-8d7e-0a5c45ffd8fa req-0e9195fd-5a27-4141-9c14-4bbe0cfbd6dd tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:24.667341 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-2a22a105-eeb1-4955-8d7e-0a5c45ffd8fa req-0e9195fd-5a27-4141-9c14-4bbe0cfbd6dd tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] For port bb290a6d-709a-49d1-bd2e-10c0fe664657, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=bb290a6d-709a-49d1-bd2e-10c0fe664657,segment=NetworkSegment(7ece4ded-a169-4d54-b911-54a5a65cd0ce),segment_id=7ece4ded-a169-4d54-b911-54a5a65cd0ce)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:46:24.667751 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-2a22a105-eeb1-4955-8d7e-0a5c45ffd8fa req-0e9195fd-5a27-4141-9c14-4bbe0cfbd6dd tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:24.684530 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-2a22a105-eeb1-4955-8d7e-0a5c45ffd8fa req-0e9195fd-5a27-4141-9c14-4bbe0cfbd6dd tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Calling delete_port for bb290a6d-709a-49d1-bd2e-10c0fe664657 owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:46:24.779830 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f55e22b-bca4-4817-8f96-9aa6cf1c497c req-625c6eb0-0bf7-4770-9f3d-ef4f8eaae8f2 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:24.781402 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0f55e22b-bca4-4817-8f96-9aa6cf1c497c req-625c6eb0-0bf7-4770-9f3d-ef4f8eaae8f2 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 944 time: 0.0540826 Dec 09 14:46:24.834318 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0f55e22b-bca4-4817-8f96-9aa6cf1c497c req-f2d16b2e-86d4-4b12-ba75-2d811c4c8825 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0467145 Dec 09 14:46:25.052286 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-2a22a105-eeb1-4955-8d7e-0a5c45ffd8fa req-0e9195fd-5a27-4141-9c14-4bbe0cfbd6dd tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:25.064276 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['bb290a6d-709a-49d1-bd2e-10c0fe664657'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:46:25.083798 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e9195fd-5a27-4141-9c14-4bbe0cfbd6dd tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Pushing event deleted for resources: {'Port': ['ID=bb290a6d-709a-49d1-bd2e-10c0fe664657,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:25.124690 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-2a22a105-eeb1-4955-8d7e-0a5c45ffd8fa req-0e9195fd-5a27-4141-9c14-4bbe0cfbd6dd tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] No DVR routers for this DVR port bb290a6d-709a-49d1-bd2e-10c0fe664657 on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:46:25.127335 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-2a22a105-eeb1-4955-8d7e-0a5c45ffd8fa req-0e9195fd-5a27-4141-9c14-4bbe0cfbd6dd tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:25.130711 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2a22a105-eeb1-4955-8d7e-0a5c45ffd8fa req-0e9195fd-5a27-4141-9c14-4bbe0cfbd6dd tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.44 "DELETE /v2.0/ports/bb290a6d-709a-49d1-bd2e-10c0fe664657 HTTP/1.1" status: 204 len: 173 time: 0.6715400 Dec 09 14:46:25.131158 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '41c03279-323a-43f0-94a0-92862c30a78a', 'name': 'network-vif-deleted', 'tag': 'bb290a6d-709a-49d1-bd2e-10c0fe664657'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:46:25.133496 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a23cbb0d-c680-483a-b74a-1f8bedf551ca" -d '{"events": [{"server_uuid": "41c03279-323a-43f0-94a0-92862c30a78a", "name": "network-vif-deleted", "tag": "bb290a6d-709a-49d1-bd2e-10c0fe664657"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:46:25.169019 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:46:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed8c82e6-c884-400a-b969-9bf29baca934 x-openstack-request-id: req-ed8c82e6-c884-400a-b969-9bf29baca934 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:46:25.169445 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "41c03279-323a-43f0-94a0-92862c30a78a", "name": "network-vif-deleted", "tag": "bb290a6d-709a-49d1-bd2e-10c0fe664657", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:46:25.169703 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-ed8c82e6-c884-400a-b969-9bf29baca934 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:46:25.170114 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '41c03279-323a-43f0-94a0-92862c30a78a', 'name': 'network-vif-deleted', 'tag': 'bb290a6d-709a-49d1-bd2e-10c0fe664657', 'status': 'completed', 'code': 200} Dec 09 14:46:25.348268 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a447eb1-92b6-4b6d-bfb1-9ac13df0c762 req-1d259f2d-d825-4be9-acb6-a332bb8ce09b tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:25.349645 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3a447eb1-92b6-4b6d-bfb1-9ac13df0c762 req-1d259f2d-d825-4be9-acb6-a332bb8ce09b tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 943 time: 0.0491195 Dec 09 14:46:25.355315 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 0f2f1781-649a-4354-970b-2a44213cf1b4 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:46:25.359493 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 0033cc00-709a-496e-9a3b-1837dafd79dd up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:46:25.397633 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3a447eb1-92b6-4b6d-bfb1-9ac13df0c762 req-7f71dbe1-d7e2-44db-8178-32730af31b88 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411668 Dec 09 14:46:25.467197 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port 0033cc00-709a-496e-9a3b-1837dafd79dd completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:46:25.476184 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port 0033cc00-709a-496e-9a3b-1837dafd79dd triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:46:25.476559 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:25.506060 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 0f2f1781-649a-4354-970b-2a44213cf1b4, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0f2f1781-649a-4354-970b-2a44213cf1b4,segment=NetworkSegment(e2f74911-9ec7-4d46-b689-ab5ae0cbb567),segment_id=e2f74911-9ec7-4d46-b689-ab5ae0cbb567)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:46:25.520507 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': '0f2f1781-649a-4354-970b-2a44213cf1b4', 'network_id': '8ae9a24a-645d-43a9-b32c-41629b26c09e', 'port_id': '0f2f1781-649a-4354-970b-2a44213cf1b4', 'mac_address': 'fa:16:3e:c1:98:ef', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 421, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a44bb60f-825d-4a27-a5af-fbe9e6e78fb7', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:46:25.589584 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:25.610815 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0f2f1781-649a-4354-970b-2a44213cf1b4 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:46:25.624787 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:25.642570 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 0f2f1781-649a-4354-970b-2a44213cf1b4, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0f2f1781-649a-4354-970b-2a44213cf1b4,segment=NetworkSegment(e2f74911-9ec7-4d46-b689-ab5ae0cbb567),segment_id=e2f74911-9ec7-4d46-b689-ab5ae0cbb567)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:46:25.651713 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:25.660528 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0033cc00-709a-496e-9a3b-1837dafd79dd'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:46:25.662832 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cf6336cb-3ed1-4ddb-8fe1-96fde97caeed" -d '{"events": [{"server_uuid": "1556759d-80fc-4a03-accf-81a2ffccc9d1", "name": "network-vif-plugged", "status": "completed", "tag": "0033cc00-709a-496e-9a3b-1837dafd79dd"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:46:25.668661 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bb6feb28-e8e2-40c1-8292-53a38b9e275e req-061df9b8-96e6-4116-b295-b403ddcc13d3 tempest-ServerRescueNegativeTestJSON-214627039 tempest-ServerRescueNegativeTestJSON-214627039-project] 10.222.0.39 "GET /v2.0/ports?device_id=41c03279-323a-43f0-94a0-92862c30a78a HTTP/1.1" status: 200 len: 210 time: 0.0319579 Dec 09 14:46:25.694430 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 0033cc00-709a-496e-9a3b-1837dafd79dd, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0033cc00-709a-496e-9a3b-1837dafd79dd,segment=NetworkSegment(d8b4a507-9bfc-4567-82ac-77b20844733a),segment_id=d8b4a507-9bfc-4567-82ac-77b20844733a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:46:25.708721 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:25.728201 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:46:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7f9d55e2-db59-4bd6-9943-7f9af99f1b71 x-openstack-request-id: req-7f9d55e2-db59-4bd6-9943-7f9af99f1b71 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:46:25.728515 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1556759d-80fc-4a03-accf-81a2ffccc9d1", "name": "network-vif-plugged", "status": "completed", "tag": "0033cc00-709a-496e-9a3b-1837dafd79dd", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:46:25.728771 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-7f9d55e2-db59-4bd6-9943-7f9af99f1b71 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:46:25.729196 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0033cc00-709a-496e-9a3b-1837dafd79dd', 'code': 200} Dec 09 14:46:25.730142 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=0f2f1781-649a-4354-970b-2a44213cf1b4,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:25.790832 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=0033cc00-709a-496e-9a3b-1837dafd79dd,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:25.966098 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6a83360-92e9-4c1e-821a-8823cf97a88f req-f1b446c3-cbd7-40c5-904b-d09524365c02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:25.967586 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a6a83360-92e9-4c1e-821a-8823cf97a88f req-f1b446c3-cbd7-40c5-904b-d09524365c02 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 1098 time: 0.0679657 Dec 09 14:46:25.975943 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['0f2f1781-649a-4354-970b-2a44213cf1b4'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:46:25.982109 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2110226c-e28e-4da7-8b34-4f0e9bbb88b3 req-8b178bbd-8e17-4a04-93b0-62c3cc7ada54 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:25.983495 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2110226c-e28e-4da7-8b34-4f0e9bbb88b3 req-8b178bbd-8e17-4a04-93b0-62c3cc7ada54 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 945 time: 0.0599279 Dec 09 14:46:26.045098 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a6a83360-92e9-4c1e-821a-8823cf97a88f req-b996153b-96d8-43cd-aa2b-0d34efa3b607 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0605998 Dec 09 14:46:26.056436 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2110226c-e28e-4da7-8b34-4f0e9bbb88b3 req-c408d448-a134-4224-a045-d256b146d21a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659044 Dec 09 14:46:26.526552 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-415197e2-20f1-4a35-b9a4-3bdcac541e81 req-d75e1dc3-a071-421d-acb4-3ad8604c2482 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:26.528052 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-415197e2-20f1-4a35-b9a4-3bdcac541e81 req-d75e1dc3-a071-421d-acb4-3ad8604c2482 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 944 time: 0.0496006 Dec 09 14:46:26.583703 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-415197e2-20f1-4a35-b9a4-3bdcac541e81 req-ab4d6aad-7529-4ed9-89b8-f32c310b683f tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465884 Dec 09 14:46:26.736532 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58012) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:46:26.997073 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-1be00e00-1f14-46c2-bcde-dd5e67ccb28c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:27.170505 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1629277'] for router_interface, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:27.222518 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-540cb2ff-4ca2-4c3b-b0bd-511c08be28d0 req-832df3ae-7bdc-404e-b1d5-91f5a5216036 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:27.224027 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-540cb2ff-4ca2-4c3b-b0bd-511c08be28d0 req-832df3ae-7bdc-404e-b1d5-91f5a5216036 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 945 time: 0.0952601 Dec 09 14:46:27.314348 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-540cb2ff-4ca2-4c3b-b0bd-511c08be28d0 req-1d9fa940-2a44-44be-ad6a-90b387e83665 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0820615 Dec 09 14:46:27.371251 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 0f2f1781-649a-4354-970b-2a44213cf1b4 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:46:27.513996 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Deleting port 35277c8d-e624-48fc-97ae-fcec8459f3ca {{(pid=109062) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:46:27.514310 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:27.551125 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port 0f2f1781-649a-4354-970b-2a44213cf1b4 completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:46:27.555004 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port 0f2f1781-649a-4354-970b-2a44213cf1b4 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:46:27.555391 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:27.592406 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.db [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] For port 35277c8d-e624-48fc-97ae-fcec8459f3ca, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=35277c8d-e624-48fc-97ae-fcec8459f3ca,segment=NetworkSegment(7ece4ded-a169-4d54-b911-54a5a65cd0ce),segment_id=7ece4ded-a169-4d54-b911-54a5a65cd0ce)] {{(pid=109062) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:46:27.592991 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:27.605659 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Calling delete_port for 35277c8d-e624-48fc-97ae-fcec8459f3ca owned by network:router_interface {{(pid=109062) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:46:27.630912 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:27.665796 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 0f2f1781-649a-4354-970b-2a44213cf1b4, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0f2f1781-649a-4354-970b-2a44213cf1b4,segment=NetworkSegment(e2f74911-9ec7-4d46-b689-ab5ae0cbb567),segment_id=e2f74911-9ec7-4d46-b689-ab5ae0cbb567)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:46:27.671324 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:27.672299 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device bb290a6d-709a-49d1-bd2e-10c0fe664657 no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:46:27.705404 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-286ed54c-3b10-49dc-b6e8-6b5f8456f30c req-a5144bec-32d6-4746-9e76-c00efe657639 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:27.710517 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-286ed54c-3b10-49dc-b6e8-6b5f8456f30c req-a5144bec-32d6-4746-9e76-c00efe657639 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 944 time: 0.0532501 Dec 09 14:46:27.711060 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: bb290a6d-709a-49d1-bd2e-10c0fe664657 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:46:27.711417 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device bb290a6d-709a-49d1-bd2e-10c0fe664657 not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:46:27.737206 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7cee90e4-4ab9-4ff3-865b-7c84761d82c9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0f2f1781-649a-4354-970b-2a44213cf1b4'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:46:27.739597 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9acf033c-66d5-4a25-a519-489450850d08" -d '{"events": [{"server_uuid": "7cee90e4-4ab9-4ff3-865b-7c84761d82c9", "name": "network-vif-plugged", "status": "completed", "tag": "0f2f1781-649a-4354-970b-2a44213cf1b4"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:46:27.748059 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=0f2f1781-649a-4354-970b-2a44213cf1b4,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:27.771711 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-286ed54c-3b10-49dc-b6e8-6b5f8456f30c req-3a1f29d3-2999-4fd4-b317-2e7279414f88 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516381 Dec 09 14:46:27.782267 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:46:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-89b5fc5a-22eb-486e-93eb-ac87055f77c0 x-openstack-request-id: req-89b5fc5a-22eb-486e-93eb-ac87055f77c0 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:46:27.782589 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7cee90e4-4ab9-4ff3-865b-7c84761d82c9", "name": "network-vif-plugged", "status": "completed", "tag": "0f2f1781-649a-4354-970b-2a44213cf1b4", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:46:27.782880 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-89b5fc5a-22eb-486e-93eb-ac87055f77c0 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:46:27.783271 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7cee90e4-4ab9-4ff3-865b-7c84761d82c9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0f2f1781-649a-4354-970b-2a44213cf1b4', 'code': 200} Dec 09 14:46:27.822995 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:27.850827 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Pushing event deleted for resources: {'Port': ['ID=35277c8d-e624-48fc-97ae-fcec8459f3ca,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:27.875938 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:27.876305 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:27.876682 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:27.877068 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:27.877494 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:27.877830 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:27.878170 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:27.878581 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:27.879003 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:27.879390 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:27.879712 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:27.880101 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:27.880435 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:27.961532 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02dca331-0499-436c-9774-639420222a8e req-a6744a68-087f-4a43-8adb-4d833a64d88f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:27.963158 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-02dca331-0499-436c-9774-639420222a8e req-a6744a68-087f-4a43-8adb-4d833a64d88f service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 1098 time: 0.0414684 Dec 09 14:46:28.011971 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-02dca331-0499-436c-9774-639420222a8e req-cc161ae0-7bb9-4e13-897c-a667787212cb service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411546 Dec 09 14:46:28.013050 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2066028', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1629233'] for router_interface, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:28.230077 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Router 434b7b17-3c79-4e21-9abd-a8db38cd0969 has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:46:28.332012 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:46:28.337411 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-e67874a6-8bf4-4a30-97de-44b757328d74 admin admin] 10.222.0.39 "PUT /v2.0/routers/434b7b17-3c79-4e21-9abd-a8db38cd0969/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5998077 Dec 09 14:46:28.340159 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 58022) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:46:28.341981 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1dcaf337-7e52-418f-8ac8-725d4a3fd9b8 None None] Sync routers for ids ['434b7b17-3c79-4e21-9abd-a8db38cd0969'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:46:28.354197 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dcaf337-7e52-418f-8ac8-725d4a3fd9b8 None None] Routers {'434b7b17-3c79-4e21-9abd-a8db38cd0969'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:46:28.354966 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-1dcaf337-7e52-418f-8ac8-725d4a3fd9b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:45:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['434b7b17-3c79-4e21-9abd-a8db38cd0969'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:46:28.434176 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1895ee6c-66fc-428d-b571-b174a2bcb2af req-14938e9a-df0d-4e81-9710-023aab72b8c5 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:28.435944 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1895ee6c-66fc-428d-b571-b174a2bcb2af req-14938e9a-df0d-4e81-9710-023aab72b8c5 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 945 time: 0.0509064 Dec 09 14:46:28.446413 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] Publish callbacks [] for router, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:28.460545 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-1dcaf337-7e52-418f-8ac8-725d4a3fd9b8 None None] Set router 434b7b17-3c79-4e21-9abd-a8db38cd0969 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:46:28.485885 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1895ee6c-66fc-428d-b571-b174a2bcb2af req-d943b526-9306-4472-818e-de21b416d032 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425687 Dec 09 14:46:28.563384 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:28.626843 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11aac949-2a4f-4525-bc19-85773bfff16e req-37522e45-554b-41fe-8f5a-acfb38020778 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:28.628349 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-11aac949-2a4f-4525-bc19-85773bfff16e req-37522e45-554b-41fe-8f5a-acfb38020778 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 945 time: 0.0743923 Dec 09 14:46:28.637800 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-1dcaf337-7e52-418f-8ac8-725d4a3fd9b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'name': 'tempest-ServerRescueNegativeTestJSON-257021972-router', 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.159'}], 'enable_snat': True}, 'gw_port_id': '773a261e-796a-4ef7-b21d-e5fd6cad9fe8', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:35Z', 'updated_at': '2021-12-09T14:46:27Z', 'revision_number': 5, 'project_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'gw_port': {'id': '773a261e-796a-4ef7-b21d-e5fd6cad9fe8', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:87:29:52', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'device_owner': 'network:router_gateway', 'standard_attr_id': 91, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.159', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:46:28.666747 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1dcaf337-7e52-418f-8ac8-725d4a3fd9b8 None None] Checking router: 434b7b17-3c79-4e21-9abd-a8db38cd0969 for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:46:28.673229 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] Deleting port 773a261e-796a-4ef7-b21d-e5fd6cad9fe8 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:46:28.673728 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:28.675385 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1dcaf337-7e52-418f-8ac8-725d4a3fd9b8 None None] Routers {'434b7b17-3c79-4e21-9abd-a8db38cd0969'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:46:28.676013 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-1dcaf337-7e52-418f-8ac8-725d4a3fd9b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 8, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 8, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:45:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['434b7b17-3c79-4e21-9abd-a8db38cd0969'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:46:28.723683 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-11aac949-2a4f-4525-bc19-85773bfff16e req-1320112f-1e42-4061-b0ab-7c3fead3150f tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0885713 Dec 09 14:46:28.761515 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-1dcaf337-7e52-418f-8ac8-725d4a3fd9b8 None None] Set router 434b7b17-3c79-4e21-9abd-a8db38cd0969 gateway port host: None {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:46:28.766710 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] For port 773a261e-796a-4ef7-b21d-e5fd6cad9fe8, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=773a261e-796a-4ef7-b21d-e5fd6cad9fe8,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:46:28.767106 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:28.779481 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] Calling delete_port for 773a261e-796a-4ef7-b21d-e5fd6cad9fe8 owned by network:router_gateway {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:46:28.814493 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-1dcaf337-7e52-418f-8ac8-725d4a3fd9b8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'name': 'tempest-ServerRescueNegativeTestJSON-257021972-router', 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:35Z', 'updated_at': '2021-12-09T14:46:28Z', 'revision_number': 6, 'project_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'gw_port_host': None}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:46:28.843307 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1dcaf337-7e52-418f-8ac8-725d4a3fd9b8 None None] The sync data for ids ['434b7b17-3c79-4e21-9abd-a8db38cd0969'] in dv-cinder-819692-8-iscsi is: [{'id': '434b7b17-3c79-4e21-9abd-a8db38cd0969', 'name': 'tempest-ServerRescueNegativeTestJSON-257021972-router', 'tenant_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:35Z', 'updated_at': '2021-12-09T14:46:28Z', 'revision_number': 6, 'project_id': '3d298e3ebec54c2281ddf8bbb50b7cea', 'gw_port_host': None}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:46:28.948651 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b7485a-e536-4195-9eec-4a86d708511b req-64e624d8-5937-438f-9cfc-8e1e40a29e2c tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:28.950187 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-49b7485a-e536-4195-9eec-4a86d708511b req-64e624d8-5937-438f-9cfc-8e1e40a29e2c tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 945 time: 0.1018355 Dec 09 14:46:29.033249 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-49b7485a-e536-4195-9eec-4a86d708511b req-b0727675-accf-44b5-b2eb-f935ba98ba9c tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0751226 Dec 09 14:46:29.034965 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.060391 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69fb029d-6a2a-41cd-991c-9c2cfb14ffde req-fa46b510-112b-41b9-b780-037c5ffe7e8f tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:29.062379 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-69fb029d-6a2a-41cd-991c-9c2cfb14ffde req-fa46b510-112b-41b9-b780-037c5ffe7e8f tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 945 time: 0.0540257 Dec 09 14:46:29.064306 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] Pushing event deleted for resources: {'Port': ['ID=773a261e-796a-4ef7-b21d-e5fd6cad9fe8,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:29.113085 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-69fb029d-6a2a-41cd-991c-9c2cfb14ffde req-f8eaa9f0-65ac-49aa-ad4e-60095d183dc1 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442872 Dec 09 14:46:29.127630 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1574291'] for router_gateway, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.195152 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-9b805d3a-e655-4e2e-87bd-751bf7162a9a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.267117 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1626627', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30560'] for router, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.269572 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.355927 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1626682'] for router, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.356277 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 35277c8d-e624-48fc-97ae-fcec8459f3ca no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:46:29.356689 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] Fanout notify agent at l3_agent the message router_deleted on router 434b7b17-3c79-4e21-9abd-a8db38cd0969 {{(pid=109061) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 14:46:29.379208 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 35277c8d-e624-48fc-97ae-fcec8459f3ca {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:46:29.379644 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 35277c8d-e624-48fc-97ae-fcec8459f3ca not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:46:29.385764 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.390617 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-b33ef300-882b-48c3-a90f-97eb4a9953ee admin admin] 10.222.0.39 "DELETE /v2.0/routers/434b7b17-3c79-4e21-9abd-a8db38cd0969 HTTP/1.1" status: 204 len: 168 time: 1.0460896 Dec 09 14:46:29.391363 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58038) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:46:29.445805 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_v2 [None req-be2b785e-8825-4397-876a-9b5a132b9fe0 admin admin] Deleting subnet 90388423-2d07-4cbe-80d8-fa2f6a3c14f7 {{(pid=109062) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:46:29.448993 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-be2b785e-8825-4397-876a-9b5a132b9fe0 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.484247 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-be2b785e-8825-4397-876a-9b5a132b9fe0 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-130415749'] for subnet, precommit_delete_associations {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.525070 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-be2b785e-8825-4397-876a-9b5a132b9fe0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.576562 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-be2b785e-8825-4397-876a-9b5a132b9fe0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-130461228', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-130768914'] for subnet, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.600147 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be2b785e-8825-4397-876a-9b5a132b9fe0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=90388423-2d07-4cbe-80d8-fa2f6a3c14f7,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:29.603888 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-be2b785e-8825-4397-876a-9b5a132b9fe0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.606994 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-be2b785e-8825-4397-876a-9b5a132b9fe0 admin admin] 10.222.0.39 "DELETE /v2.0/subnets/90388423-2d07-4cbe-80d8-fa2f6a3c14f7 HTTP/1.1" status: 204 len: 168 time: 0.2145865 Dec 09 14:46:29.609656 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58040) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:46:29.677540 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a7eaa012-ad67-4564-aa14-080bd82e3538 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.762868 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a7eaa012-ad67-4564-aa14-080bd82e3538 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.784232 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-a7eaa012-ad67-4564-aa14-080bd82e3538 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8ff38a1e-5122-4806-8b7d-d4c281cbe550']}} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:46:29.793686 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-a7eaa012-ad67-4564-aa14-080bd82e3538 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7ece4ded-a169-4d54-b911-54a5a65cd0ce') {'for_net_delete': True} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:46:29.794021 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-a7eaa012-ad67-4564-aa14-080bd82e3538 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7ece4ded-a169-4d54-b911-54a5a65cd0ce') {} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:46:29.803474 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a7eaa012-ad67-4564-aa14-080bd82e3538 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-130415758'] for segment, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.817055 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a7eaa012-ad67-4564-aa14-080bd82e3538 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.823460 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a7eaa012-ad67-4564-aa14-080bd82e3538 admin admin] Releasing vlan 425 on physical network physnet1 to pool {{(pid=109062) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:46:29.823868 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a7eaa012-ad67-4564-aa14-080bd82e3538 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-130461398'] for segment, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: Traceback (most recent call last): Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: timer() Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: cb(*args, **kw) Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: return func(*args, **kwargs) Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: self._notify() Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: self.callback(batched_events) Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: event.method(event) Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: return f(self, *a, **k) Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._get(url).json() Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: return self.request(url, 'GET', **kwargs) Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:46:29.825568 dv-cinder-819692-8-iscsi neutron-server[109062]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:46:29.880377 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a7eaa012-ad67-4564-aa14-080bd82e3538 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.884978 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a7eaa012-ad67-4564-aa14-080bd82e3538 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:29.888324 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-a7eaa012-ad67-4564-aa14-080bd82e3538 admin admin] 10.222.0.39 "DELETE /v2.0/networks/8ff38a1e-5122-4806-8b7d-d4c281cbe550 HTTP/1.1" status: 204 len: 168 time: 0.2777355 Dec 09 14:46:29.905930 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7eaa012-ad67-4564-aa14-080bd82e3538 admin admin] Pushing event deleted for resources: {'Network': ['ID=8ff38a1e-5122-4806-8b7d-d4c281cbe550,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:30.062136 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 58046) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:46:30.105082 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-73ad8ed5-7be8-4a76-8b76-ac990abacc27 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=3d298e3ebec54c2281ddf8bbb50b7cea&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0392973 Dec 09 14:46:30.105520 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58048) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:46:30.150584 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-609268c0-2290-45a9-b353-44060e3fc30b req-e2dc157a-b492-4c1b-aa82-d381877d4299 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:30.152128 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-609268c0-2290-45a9-b353-44060e3fc30b req-e2dc157a-b492-4c1b-aa82-d381877d4299 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 945 time: 0.0484240 Dec 09 14:46:30.153704 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-11778dbf-e7f3-44dc-b67e-08d2403a29d3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:30.175488 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-11778dbf-e7f3-44dc-b67e-08d2403a29d3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:30.199519 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-609268c0-2290-45a9-b353-44060e3fc30b req-ada415bd-34b1-49a3-95c5-b511059488e5 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411966 Dec 09 14:46:30.223672 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-11778dbf-e7f3-44dc-b67e-08d2403a29d3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:30.226662 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-11778dbf-e7f3-44dc-b67e-08d2403a29d3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:30.230209 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-11778dbf-e7f3-44dc-b67e-08d2403a29d3 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/4d3151d2-417f-4569-9d44-49489aa9418d HTTP/1.1" status: 204 len: 168 time: 0.1209457 Dec 09 14:46:30.237074 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11778dbf-e7f3-44dc-b67e-08d2403a29d3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d3151d2-417f-4569-9d44-49489aa9418d,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:30.426984 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:31.043099 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 773a261e-796a-4ef7-b21d-e5fd6cad9fe8 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:46:31.066489 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 773a261e-796a-4ef7-b21d-e5fd6cad9fe8 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:46:31.066839 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 773a261e-796a-4ef7-b21d-e5fd6cad9fe8 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:46:31.438077 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:46:31.795979 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:32.626824 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:44.810913 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:48.734305 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ca5bfcf6-2405-47d5-ac4c-b42857507f59 req-41b2a336-39e5-4dcf-aaed-318f21440776 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0407889 Dec 09 14:46:48.804235 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca5bfcf6-2405-47d5-ac4c-b42857507f59 req-4160e7d9-2b1d-48a6-b1f7-ddd346294717 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:48.805703 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ca5bfcf6-2405-47d5-ac4c-b42857507f59 req-4160e7d9-2b1d-48a6-b1f7-ddd346294717 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=a538bf01cb5440ffa06b6873f212efaa&device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 1098 time: 0.0465040 Dec 09 14:46:48.915201 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca5bfcf6-2405-47d5-ac4c-b42857507f59 req-538c7b77-ea5f-4a2b-92ad-33c943ce0da7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:48.916687 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ca5bfcf6-2405-47d5-ac4c-b42857507f59 req-538c7b77-ea5f-4a2b-92ad-33c943ce0da7 service neutron] 10.222.0.44 "GET /v2.0/networks?id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b HTTP/1.1" status: 200 len: 911 time: 0.0862634 Dec 09 14:46:48.991352 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ca5bfcf6-2405-47d5-ac4c-b42857507f59 req-159e15e0-a675-459d-b0ef-3ca659615607 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c5d8b8cc-2c67-46a7-867d-276136fccdf1 HTTP/1.1" status: 200 len: 1000 time: 0.0595429 Dec 09 14:46:49.044054 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca5bfcf6-2405-47d5-ac4c-b42857507f59 req-e0ca0b64-1b1f-4bf3-8a20-6b2fdcac4282 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:49.045676 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ca5bfcf6-2405-47d5-ac4c-b42857507f59 req-e0ca0b64-1b1f-4bf3-8a20-6b2fdcac4282 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=4b7e026c-4454-4200-91c3-30d27a976452 HTTP/1.1" status: 200 len: 849 time: 0.0453165 Dec 09 14:46:49.099987 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca5bfcf6-2405-47d5-ac4c-b42857507f59 req-25824841-1d1c-4728-8432-674f6ae4d6d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:49.101516 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ca5bfcf6-2405-47d5-ac4c-b42857507f59 req-25824841-1d1c-4728-8432-674f6ae4d6d6 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0422578 Dec 09 14:46:49.197610 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ca5bfcf6-2405-47d5-ac4c-b42857507f59 req-cc8de2b5-3971-41f3-818a-3d672c82fd09 service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852332 Dec 09 14:46:49.292810 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ca5bfcf6-2405-47d5-ac4c-b42857507f59 req-cd760741-8b73-4d06-846a-fd9acc13b1a4 service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0817573 Dec 09 14:46:54.408258 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7ef485b-edfa-4136-9f0f-c3553b91c4e9 req-f3eef3d7-2b48-493c-b3b0-fa04f6b44bdd tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:54.409734 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c7ef485b-edfa-4136-9f0f-c3553b91c4e9 req-f3eef3d7-2b48-493c-b3b0-fa04f6b44bdd tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 945 time: 0.0581229 Dec 09 14:46:54.460360 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c7ef485b-edfa-4136-9f0f-c3553b91c4e9 req-9dce9e9b-4883-4f40-9274-e39103b24773 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443854 Dec 09 14:46:54.483894 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 58362) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:46:54.678754 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4a7d9ff2-caf9-4027-9235-e8e2cf7ec06c tempest-TestMinimumBasicScenario-888352001 tempest-TestMinimumBasicScenario-888352001-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:54.680369 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-4a7d9ff2-caf9-4027-9235-e8e2cf7ec06c tempest-TestMinimumBasicScenario-888352001 tempest-TestMinimumBasicScenario-888352001-project-admin] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 1093 time: 0.1955054 Dec 09 14:46:54.683457 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58374) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:46:54.688159 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Request body: {'floatingip': {'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'port_id': '0033cc00-709a-496e-9a3b-1837dafd79dd', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'fixed_ip_address': '172.20.0.4'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:46:54.711189 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for floatingip, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:55.011792 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa4fa656-6b01-463d-b22c-e9ef430a5390 req-c80946bf-82fe-49f8-9a61-08c9068ecba7 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:55.013417 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-aa4fa656-6b01-463d-b22c-e9ef430a5390 req-c80946bf-82fe-49f8-9a61-08c9068ecba7 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0521064 Dec 09 14:46:55.048109 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:55.064050 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-aa4fa656-6b01-463d-b22c-e9ef430a5390 req-66c813f8-73ea-4f70-843b-f58e2b657e5d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439608 Dec 09 14:46:55.151141 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Allocated IP 172.27.0.209 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/e0fe9fc7-2341-413b-8242-0996736e1018) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:46:55.260327 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:55.296745 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:55.332435 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:46:55.337304 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:46:55.340811 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:46:55.346171 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Pushing event updated for resources: {'Port': ['ID=e0fe9fc7-2341-413b-8242-0996736e1018,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:55.695403 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:55.770045 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:55.915876 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:55.923667 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-130461426'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:55.988790 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Pushing event updated for resources: {'Port': ['ID=e0fe9fc7-2341-413b-8242-0996736e1018,revision_number=2']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:56.005177 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:56.112472 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.l3_db [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Floating IP 5ec3442d-6600-4ea6-a436-903eca8d2dfd associated. External IP: 172.27.0.209, port: 0033cc00-709a-496e-9a3b-1837dafd79dd. Dec 09 14:46:56.238448 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88974465-0b84-425b-b207-7cbb33efa4d8 req-19262630-c882-429f-9f7c-3cee3aa7c8c2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:56.240005 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-88974465-0b84-425b-b207-7cbb33efa4d8 req-19262630-c882-429f-9f7c-3cee3aa7c8c2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0928025 Dec 09 14:46:56.327191 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-88974465-0b84-425b-b207-7cbb33efa4d8 req-96f0d6ea-c7e4-4378-8850-bdbca63e45ca tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0806122 Dec 09 14:46:56.385762 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Router 24108286-6fa2-4e97-9fab-de1871d0c79d has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:46:56.494098 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:46:56.505810 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e167863e-ff80-4286-9dc8-ad8f690daffd None None] Sync routers for ids ['24108286-6fa2-4e97-9fab-de1871d0c79d'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:46:56.514047 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:56.516427 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e167863e-ff80-4286-9dc8-ad8f690daffd None None] Routers {'24108286-6fa2-4e97-9fab-de1871d0c79d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:46:56.517262 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-e167863e-ff80-4286-9dc8-ad8f690daffd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:46:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['24108286-6fa2-4e97-9fab-de1871d0c79d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:46:56.541607 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-daa7c2f4-aea9-4497-9793-41f3af62f75b tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8568745 Dec 09 14:46:56.542292 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'tag': '0033cc00-709a-496e-9a3b-1837dafd79dd'}] {{(pid=109062) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:46:56.544691 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 58398) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:46:56.545177 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3f1ec408b0eec5a36b56e0a757eff0f4875d9a95eff62f4d0b4a62bb27a3b600" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8c3e3b3a-bc99-4169-b5f8-fe69a0f08f50" -d '{"events": [{"name": "network-changed", "server_uuid": "1556759d-80fc-4a03-accf-81a2ffccc9d1", "tag": "0033cc00-709a-496e-9a3b-1837dafd79dd"}]}' {{(pid=109062) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:46:56.549642 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-315201565', 'description': 'tempest-secgroup-smoke-315201565 description', 'project_id': 'ed13d07c829a42dca57ff23f7538ecda'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:46:56.581704 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:56.586822 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:46:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9afcc018-2677-4df3-a032-7cc32e414726 x-openstack-request-id: req-9afcc018-2677-4df3-a032-7cc32e414726 {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:46:56.587124 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1556759d-80fc-4a03-accf-81a2ffccc9d1", "tag": "0033cc00-709a-496e-9a3b-1837dafd79dd", "status": "completed", "code": 200}]} {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:46:56.587381 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-9afcc018-2677-4df3-a032-7cc32e414726 {{(pid=109062) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:46:56.587833 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'tag': '0033cc00-709a-496e-9a3b-1837dafd79dd', 'status': 'completed', 'code': 200} Dec 09 14:46:56.624933 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-e167863e-ff80-4286-9dc8-ad8f690daffd None None] Set router 24108286-6fa2-4e97-9fab-de1871d0c79d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:46:56.657348 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:56.661972 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:56.690821 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:56.694759 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.1461580 Dec 09 14:46:56.694759 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Pushing event updated for resources: {'SecurityGroup': ['ID=b198c154-3d21-435b-8a30-9196034aed82,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:56.695112 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58402) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:46:56.699803 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-c854522b-a85f-4902-abfc-f74463a7c523 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Request body: {'security_group_rule': {'security_group_id': 'b198c154-3d21-435b-8a30-9196034aed82', 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:46:56.702125 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:56.702544 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:56.702957 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:56.703456 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:56.703796 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:56.705223 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:56.705223 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:56.705223 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:56.705223 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:56.705677 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:56.706224 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:56.706790 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:56.707189 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-053eac88-f8e4-468f-80a9-ae9a85e9c729 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:46:56.737743 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c854522b-a85f-4902-abfc-f74463a7c523 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:56.791402 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c854522b-a85f-4902-abfc-f74463a7c523 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:56.797233 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c854522b-a85f-4902-abfc-f74463a7c523 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:56.816634 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c854522b-a85f-4902-abfc-f74463a7c523 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=efaa0a08-a586-4515-9018-ef412ea0fc5e,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:56.824184 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c854522b-a85f-4902-abfc-f74463a7c523 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:56.827999 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-c854522b-a85f-4902-abfc-f74463a7c523 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1293259 Dec 09 14:46:56.828501 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 58406) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:46:56.833228 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-1df2d148-bd1b-4185-8b5e-6d65a98bd21a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Request body: {'security_group_rule': {'security_group_id': 'b198c154-3d21-435b-8a30-9196034aed82', 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:46:56.866466 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1df2d148-bd1b-4185-8b5e-6d65a98bd21a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:56.907717 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-e167863e-ff80-4286-9dc8-ad8f690daffd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:46Z', 'revision_number': 4, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'gw_port': {'id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:56:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '5ec3442d-6600-4ea6-a436-903eca8d2dfd', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'floating_ip_address': '172.27.0.209', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'port_id': '0033cc00-709a-496e-9a3b-1837dafd79dd', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 475, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'mac_address': 'fa:16:3e:dc:db:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:46:55Z', 'updated_at': '2021-12-09T14:46:55Z', 'revision_number': 0, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f8899dd4-cd7b-4334-8f00-998be8a48481', 'name': '', 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'mac_address': 'fa:16:3e:c0:25:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:46Z', 'updated_at': '2021-12-09T14:45:51Z', 'revision_number': 5, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'subnets': [{'id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:46:56.920692 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1df2d148-bd1b-4185-8b5e-6d65a98bd21a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:56.925055 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1df2d148-bd1b-4185-8b5e-6d65a98bd21a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:56.936045 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e167863e-ff80-4286-9dc8-ad8f690daffd None None] Checking router: 24108286-6fa2-4e97-9fab-de1871d0c79d for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:46:56.944038 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1df2d148-bd1b-4185-8b5e-6d65a98bd21a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=95c318f2-d68c-4f1e-83b7-a8f0cc9a7e12,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:56.948753 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e167863e-ff80-4286-9dc8-ad8f690daffd None None] Routers {'24108286-6fa2-4e97-9fab-de1871d0c79d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:46:56.949392 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-e167863e-ff80-4286-9dc8-ad8f690daffd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 8},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:46:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['24108286-6fa2-4e97-9fab-de1871d0c79d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:46:56.951843 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1df2d148-bd1b-4185-8b5e-6d65a98bd21a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:56.953215 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-1df2d148-bd1b-4185-8b5e-6d65a98bd21a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1236134 Dec 09 14:46:56.956071 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58410) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:46:56.961100 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-0ea3ef00-d963-451c-89dc-c57a6c793a54 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Request body: {'security_group_rule': {'security_group_id': 'b198c154-3d21-435b-8a30-9196034aed82', 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:46:56.989565 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0ea3ef00-d963-451c-89dc-c57a6c793a54 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.022720 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-c20ae92b-0b91-415a-99d4-e64de75679de None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.049359 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0ea3ef00-d963-451c-89dc-c57a6c793a54 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.054290 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0ea3ef00-d963-451c-89dc-c57a6c793a54 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.071725 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ea3ef00-d963-451c-89dc-c57a6c793a54 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f817a752-2832-411d-a59f-6c3c6a039774,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:57.076489 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-e167863e-ff80-4286-9dc8-ad8f690daffd None None] Set router 24108286-6fa2-4e97-9fab-de1871d0c79d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:46:57.085428 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-0ea3ef00-d963-451c-89dc-c57a6c793a54 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.086645 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-0ea3ef00-d963-451c-89dc-c57a6c793a54 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1291590 Dec 09 14:46:57.089297 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58412) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:46:57.093584 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-c16a286c-c410-40a3-9f6f-a9beb0f20637 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Request body: {'security_group_rule': {'security_group_id': 'b198c154-3d21-435b-8a30-9196034aed82', 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:46:57.120462 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c16a286c-c410-40a3-9f6f-a9beb0f20637 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.177728 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c16a286c-c410-40a3-9f6f-a9beb0f20637 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.182530 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c16a286c-c410-40a3-9f6f-a9beb0f20637 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.200330 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c16a286c-c410-40a3-9f6f-a9beb0f20637 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dbf18276-caae-43e1-9e77-b1270d03db33,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:57.207451 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c16a286c-c410-40a3-9f6f-a9beb0f20637 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.208675 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-c16a286c-c410-40a3-9f6f-a9beb0f20637 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1184397 Dec 09 14:46:57.211463 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58414) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:46:57.215878 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-e95c712d-1e28-4998-bf3e-63463107fe33 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Request body: {'security_group_rule': {'security_group_id': 'b198c154-3d21-435b-8a30-9196034aed82', 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:46:57.237647 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.securitygroups_db [None req-e95c712d-1e28-4998-bf3e-63463107fe33 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Project ed13d07c829a42dca57ff23f7538ecda added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 14:46:57.243203 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e95c712d-1e28-4998-bf3e-63463107fe33 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.300740 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-e167863e-ff80-4286-9dc8-ad8f690daffd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:46Z', 'revision_number': 4, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'gw_port': {'id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:56:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '5ec3442d-6600-4ea6-a436-903eca8d2dfd', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'floating_ip_address': '172.27.0.209', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'port_id': '0033cc00-709a-496e-9a3b-1837dafd79dd', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 475, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'mac_address': 'fa:16:3e:dc:db:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:46:55Z', 'updated_at': '2021-12-09T14:46:55Z', 'revision_number': 0, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f8899dd4-cd7b-4334-8f00-998be8a48481', 'name': '', 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'mac_address': 'fa:16:3e:c0:25:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:46Z', 'updated_at': '2021-12-09T14:45:51Z', 'revision_number': 5, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'subnets': [{'id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:46:57.303068 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e95c712d-1e28-4998-bf3e-63463107fe33 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.308025 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e95c712d-1e28-4998-bf3e-63463107fe33 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.325551 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e95c712d-1e28-4998-bf3e-63463107fe33 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cfdf1288-9d9d-454f-8505-27359831ec58,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:57.326811 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e167863e-ff80-4286-9dc8-ad8f690daffd None None] The sync data for ids ['24108286-6fa2-4e97-9fab-de1871d0c79d'] in dv-cinder-819692-8-iscsi is: [{'id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:46Z', 'revision_number': 4, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'gw_port': {'id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:56:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '5ec3442d-6600-4ea6-a436-903eca8d2dfd', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'floating_ip_address': '172.27.0.209', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'port_id': '0033cc00-709a-496e-9a3b-1837dafd79dd', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 475, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'mac_address': 'fa:16:3e:dc:db:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:46:55Z', 'updated_at': '2021-12-09T14:46:55Z', 'revision_number': 0, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'f8899dd4-cd7b-4334-8f00-998be8a48481', 'name': '', 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'mac_address': 'fa:16:3e:c0:25:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:46Z', 'updated_at': '2021-12-09T14:45:51Z', 'revision_number': 5, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'subnets': [{'id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:46:57.333797 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e95c712d-1e28-4998-bf3e-63463107fe33 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.334996 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-e95c712d-1e28-4998-bf3e-63463107fe33 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1225345 Dec 09 14:46:57.337739 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58416) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:46:57.342573 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-40fd364f-b0f5-4cd7-b07b-e7c3fbbd5115 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Request body: {'security_group_rule': {'security_group_id': 'b198c154-3d21-435b-8a30-9196034aed82', 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:46:57.371871 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.securitygroups_db [None req-40fd364f-b0f5-4cd7-b07b-e7c3fbbd5115 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Project ed13d07c829a42dca57ff23f7538ecda added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 14:46:57.377436 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-40fd364f-b0f5-4cd7-b07b-e7c3fbbd5115 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.467803 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-40fd364f-b0f5-4cd7-b07b-e7c3fbbd5115 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.479470 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2953c6aa-b706-4c8c-a8e5-97150661b74b req-15480972-41ae-4008-a8e4-ce6ffa103dc5 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:57.481088 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2953c6aa-b706-4c8c-a8e5-97150661b74b req-15480972-41ae-4008-a8e4-ce6ffa103dc5 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0774541 Dec 09 14:46:57.482293 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-40fd364f-b0f5-4cd7-b07b-e7c3fbbd5115 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.513905 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40fd364f-b0f5-4cd7-b07b-e7c3fbbd5115 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dff7cc7b-1132-4b06-a99c-d3b56ef958e6,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:57.520754 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-40fd364f-b0f5-4cd7-b07b-e7c3fbbd5115 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.521974 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-40fd364f-b0f5-4cd7-b07b-e7c3fbbd5115 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1832376 Dec 09 14:46:57.545692 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6031259-7079-4b7e-9880-02b2ebbc2ad1 None None] New status for floating IP 5ec3442d-6600-4ea6-a436-903eca8d2dfd: ACTIVE {{(pid=109064) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:46:57.556882 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2953c6aa-b706-4c8c-a8e5-97150661b74b req-18e5d372-5c45-401d-b6f4-d5efe386fda6 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0668731 Dec 09 14:46:57.631172 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-26a8e8c9-91c7-43ca-a996-80cca02a4127 req-86c81eaf-5ff6-4604-a348-8df939e07347 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-315201565&fields=id&tenant_id=ed13d07c829a42dca57ff23f7538ecda HTTP/1.1" status: 200 len: 267 time: 0.0449128 Dec 09 14:46:57.682901 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26a8e8c9-91c7-43ca-a996-80cca02a4127 req-b7f17590-13a4-41da-ac80-66ebe974f537 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:57.684413 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-26a8e8c9-91c7-43ca-a996-80cca02a4127 req-b7f17590-13a4-41da-ac80-66ebe974f537 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 945 time: 0.0482447 Dec 09 14:46:57.696373 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-26a8e8c9-91c7-43ca-a996-80cca02a4127 req-61115a29-8bbb-4c3c-91de-017554b217af tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Request body: {'port': {'security_groups': ['7073d18f-f08a-4238-9251-53b9b9bf0865', 'b198c154-3d21-435b-8a30-9196034aed82']}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:46:57.766962 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-26a8e8c9-91c7-43ca-a996-80cca02a4127 req-61115a29-8bbb-4c3c-91de-017554b217af tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.953850 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-26a8e8c9-91c7-43ca-a996-80cca02a4127 req-61115a29-8bbb-4c3c-91de-017554b217af tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] For port 0033cc00-709a-496e-9a3b-1837dafd79dd, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0033cc00-709a-496e-9a3b-1837dafd79dd,segment=NetworkSegment(d8b4a507-9bfc-4567-82ac-77b20844733a),segment_id=d8b4a507-9bfc-4567-82ac-77b20844733a)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:46:57.992511 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-26a8e8c9-91c7-43ca-a996-80cca02a4127 req-61115a29-8bbb-4c3c-91de-017554b217af tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:57.999437 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-26a8e8c9-91c7-43ca-a996-80cca02a4127 req-61115a29-8bbb-4c3c-91de-017554b217af tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:58.044708 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26a8e8c9-91c7-43ca-a996-80cca02a4127 req-61115a29-8bbb-4c3c-91de-017554b217af tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:58.045369 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-26a8e8c9-91c7-43ca-a996-80cca02a4127 req-61115a29-8bbb-4c3c-91de-017554b217af tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:58.046795 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-26a8e8c9-91c7-43ca-a996-80cca02a4127 req-61115a29-8bbb-4c3c-91de-017554b217af tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "PUT /v2.0/ports/0033cc00-709a-496e-9a3b-1837dafd79dd HTTP/1.1" status: 200 len: 981 time: 0.3553176 Dec 09 14:46:58.047287 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'tag': '0033cc00-709a-496e-9a3b-1837dafd79dd'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:46:58.049822 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d693f97a-e06e-4e2a-9b24-a4113769bd70" -d '{"events": [{"name": "network-changed", "server_uuid": "1556759d-80fc-4a03-accf-81a2ffccc9d1", "tag": "0033cc00-709a-496e-9a3b-1837dafd79dd"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:46:58.084257 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61115a29-8bbb-4c3c-91de-017554b217af tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Pushing event updated for resources: {'Port': ['ID=0033cc00-709a-496e-9a3b-1837dafd79dd,revision_number=6']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:46:58.103999 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:46:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-af3339ec-466b-4518-a66b-dda5ea7239c0 x-openstack-request-id: req-af3339ec-466b-4518-a66b-dda5ea7239c0 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:46:58.104335 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1556759d-80fc-4a03-accf-81a2ffccc9d1", "tag": "0033cc00-709a-496e-9a3b-1837dafd79dd", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:46:58.104559 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-af3339ec-466b-4518-a66b-dda5ea7239c0 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:46:58.105454 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'tag': '0033cc00-709a-496e-9a3b-1837dafd79dd', 'status': 'completed', 'code': 200} Dec 09 14:46:58.131799 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['0033cc00-709a-496e-9a3b-1837dafd79dd'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:46:58.206308 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d693f97a-e06e-4e2a-9b24-a4113769bd70 req-a5888cd5-387c-4520-9852-be4ff82cffa4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:58.207895 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d693f97a-e06e-4e2a-9b24-a4113769bd70 req-a5888cd5-387c-4520-9852-be4ff82cffa4 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=ed13d07c829a42dca57ff23f7538ecda&device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 1137 time: 0.0578463 Dec 09 14:46:58.216802 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50795ab0-dff3-4831-b34e-c85570ed84b0 req-8839faab-eba2-42d1-b0d1-4335f4cb81d7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:58.218364 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-50795ab0-dff3-4831-b34e-c85570ed84b0 req-8839faab-eba2-42d1-b0d1-4335f4cb81d7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.1016805 Dec 09 14:46:58.282648 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['0033cc00-709a-496e-9a3b-1837dafd79dd'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:46:58.345675 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-50795ab0-dff3-4831-b34e-c85570ed84b0 req-b877a8cf-6c66-4d4f-8ac1-e83d903ed5b3 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1172843 Dec 09 14:46:58.350417 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d693f97a-e06e-4e2a-9b24-a4113769bd70 req-86f671d3-eab8-40d2-acf1-688dbf9d823a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:58.351924 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d693f97a-e06e-4e2a-9b24-a4113769bd70 req-86f671d3-eab8-40d2-acf1-688dbf9d823a service neutron] 10.222.0.44 "GET /v2.0/networks?id=ec211a40-6211-48b6-8014-deb1231b8f8a HTTP/1.1" status: 200 len: 916 time: 0.1325736 Dec 09 14:46:58.368873 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-2659b38e-8f3b-4d54-9080-c32841aa005a None None] Provisioning complete for port 0033cc00-709a-496e-9a3b-1837dafd79dd triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:46:58.369576 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-2659b38e-8f3b-4d54-9080-c32841aa005a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:58.429757 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d693f97a-e06e-4e2a-9b24-a4113769bd70 req-f4e93432-37e0-450b-a4fb-dcd8246b5005 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=0033cc00-709a-496e-9a3b-1837dafd79dd HTTP/1.1" status: 200 len: 1001 time: 0.0644817 Dec 09 14:46:58.484539 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d693f97a-e06e-4e2a-9b24-a4113769bd70 req-9265bf43-76e5-4a8f-bd28-4ad57f7d9e81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:58.486036 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d693f97a-e06e-4e2a-9b24-a4113769bd70 req-9265bf43-76e5-4a8f-bd28-4ad57f7d9e81 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=3e261ed3-068f-4b13-8a79-5f90048fcbe6 HTTP/1.1" status: 200 len: 854 time: 0.0486991 Dec 09 14:46:58.543128 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d693f97a-e06e-4e2a-9b24-a4113769bd70 req-c64a6ed0-79ec-431c-b7ad-695c4f136881 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:58.544953 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d693f97a-e06e-4e2a-9b24-a4113769bd70 req-c64a6ed0-79ec-431c-b7ad-695c4f136881 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=ec211a40-6211-48b6-8014-deb1231b8f8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0487375 Dec 09 14:46:58.646207 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d693f97a-e06e-4e2a-9b24-a4113769bd70 req-87de3fc9-1d42-4853-8e10-c80e1165cfd9 service neutron] 10.222.0.44 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0908313 Dec 09 14:46:58.699516 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3898501a-6394-48a0-b145-05d52301994f req-cf381004-5e36-4898-8b43-449051bf7a57 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:58.701388 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3898501a-6394-48a0-b145-05d52301994f req-cf381004-5e36-4898-8b43-449051bf7a57 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0617580 Dec 09 14:46:58.799815 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3898501a-6394-48a0-b145-05d52301994f req-2c4f7acb-fe8a-45dd-82aa-5ff154c4e084 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0871737 Dec 09 14:46:58.820189 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d693f97a-e06e-4e2a-9b24-a4113769bd70 req-a13be282-6559-4911-bd08-4b74703bfd20 service neutron] 10.222.0.44 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1597276 Dec 09 14:46:59.096119 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['0033cc00-709a-496e-9a3b-1837dafd79dd'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:46:59.099726 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['0033cc00-709a-496e-9a3b-1837dafd79dd'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:46:59.169414 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c3e3b3a-bc99-4169-b5f8-fe69a0f08f50 req-50c22ee8-71a3-4b15-a03b-89bb2a037baa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:59.170956 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8c3e3b3a-bc99-4169-b5f8-fe69a0f08f50 req-50c22ee8-71a3-4b15-a03b-89bb2a037baa service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=ed13d07c829a42dca57ff23f7538ecda&device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 1137 time: 0.2938223 Dec 09 14:46:59.284792 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c3e3b3a-bc99-4169-b5f8-fe69a0f08f50 req-ee1118db-c58a-41a7-8b05-6673172dc274 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:59.286327 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8c3e3b3a-bc99-4169-b5f8-fe69a0f08f50 req-ee1118db-c58a-41a7-8b05-6673172dc274 service neutron] 10.222.0.44 "GET /v2.0/networks?id=ec211a40-6211-48b6-8014-deb1231b8f8a HTTP/1.1" status: 200 len: 916 time: 0.1049571 Dec 09 14:46:59.291003 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['0033cc00-709a-496e-9a3b-1837dafd79dd'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:46:59.293061 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['0033cc00-709a-496e-9a3b-1837dafd79dd'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:46:59.295351 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['0033cc00-709a-496e-9a3b-1837dafd79dd'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:46:59.373304 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8c3e3b3a-bc99-4169-b5f8-fe69a0f08f50 req-5940165a-fa9a-4654-82ef-3b0cbb6d6eed service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=0033cc00-709a-496e-9a3b-1837dafd79dd HTTP/1.1" status: 200 len: 1001 time: 0.0757313 Dec 09 14:46:59.423231 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-9ea52e96-7677-4c52-b49c-90740e9bca1c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:46:59.428336 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c3e3b3a-bc99-4169-b5f8-fe69a0f08f50 req-2fcd9bcf-5472-485f-b89c-33f35b1706f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:59.430099 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8c3e3b3a-bc99-4169-b5f8-fe69a0f08f50 req-2fcd9bcf-5472-485f-b89c-33f35b1706f7 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=3e261ed3-068f-4b13-8a79-5f90048fcbe6 HTTP/1.1" status: 200 len: 854 time: 0.0493822 Dec 09 14:46:59.482011 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c3e3b3a-bc99-4169-b5f8-fe69a0f08f50 req-d0c5e230-bb6a-49db-817a-cceed99fab72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:59.483622 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8c3e3b3a-bc99-4169-b5f8-fe69a0f08f50 req-d0c5e230-bb6a-49db-817a-cceed99fab72 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=ec211a40-6211-48b6-8014-deb1231b8f8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0442760 Dec 09 14:46:59.580382 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8c3e3b3a-bc99-4169-b5f8-fe69a0f08f50 req-626e9fe0-d35f-4e74-a92f-c93894e650c1 service neutron] 10.222.0.44 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864224 Dec 09 14:46:59.677958 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8c3e3b3a-bc99-4169-b5f8-fe69a0f08f50 req-7c3e4342-f31d-4d1b-b595-9be3e408bc71 service neutron] 10.222.0.44 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0908773 Dec 09 14:46:59.931516 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ec24f41-c32a-4fe7-818f-3a55dcc0476f req-5f2fcb22-2e7c-46fc-a16b-5ab70cb974e3 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:46:59.932984 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1ec24f41-c32a-4fe7-818f-3a55dcc0476f req-5f2fcb22-2e7c-46fc-a16b-5ab70cb974e3 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0614164 Dec 09 14:46:59.988163 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1ec24f41-c32a-4fe7-818f-3a55dcc0476f req-dc593790-8664-4f59-b484-4a4b89ae7321 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455875 Dec 09 14:47:00.233813 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-765543a2-fbef-459f-8317-b7cef757c74f req-ce5984c9-467b-4e5b-bbc4-92d2f0dba671 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:00.235457 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-765543a2-fbef-459f-8317-b7cef757c74f req-ce5984c9-467b-4e5b-bbc4-92d2f0dba671 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 947 time: 0.0578032 Dec 09 14:47:00.299135 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-765543a2-fbef-459f-8317-b7cef757c74f req-70caa981-e600-480e-8340-0a3a846326f1 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0544946 Dec 09 14:47:00.523890 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:01.112976 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e75e58d4-65cb-4cbc-a67d-a01f01635497 req-3610fbd0-79d2-4dc5-9419-46c1b37e3bf3 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:01.114454 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e75e58d4-65cb-4cbc-a67d-a01f01635497 req-3610fbd0-79d2-4dc5-9419-46c1b37e3bf3 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0497077 Dec 09 14:47:01.167122 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e75e58d4-65cb-4cbc-a67d-a01f01635497 req-0679983a-c2fd-4a19-8823-638e0e7eb2d0 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439031 Dec 09 14:47:01.437710 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53d44ee6-cbd6-43f6-9a84-3b229a5f9a05 req-494cb009-2048-4fdf-b3fc-48dd687cea80 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:01.439243 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-53d44ee6-cbd6-43f6-9a84-3b229a5f9a05 req-494cb009-2048-4fdf-b3fc-48dd687cea80 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 947 time: 0.0544758 Dec 09 14:47:01.486921 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-53d44ee6-cbd6-43f6-9a84-3b229a5f9a05 req-dd7155a5-604e-4233-bf3f-224ec67ace01 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414922 Dec 09 14:47:01.637646 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78e6d5b8-280e-4cae-af9d-b6dd9795dc16 req-a3cfa71f-83df-4c23-86c5-d7bcae66098d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:01.639176 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-78e6d5b8-280e-4cae-af9d-b6dd9795dc16 req-a3cfa71f-83df-4c23-86c5-d7bcae66098d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 945 time: 0.0494118 Dec 09 14:47:01.686732 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-78e6d5b8-280e-4cae-af9d-b6dd9795dc16 req-ae2a7b66-3f6e-4b0e-86f3-2fbe3151a607 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0412154 Dec 09 14:47:01.803731 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:02.292965 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc63858f-6f01-4b04-b1f8-a0b7a15ac142 req-96129e3e-6be2-41e6-8d1f-1c29af9f77db tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:02.294506 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-dc63858f-6f01-4b04-b1f8-a0b7a15ac142 req-96129e3e-6be2-41e6-8d1f-1c29af9f77db tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0495801 Dec 09 14:47:02.342109 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-dc63858f-6f01-4b04-b1f8-a0b7a15ac142 req-443ff77a-24ff-4853-8669-6d8037af6c8d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413270 Dec 09 14:47:02.613461 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:02.621499 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55042962-d0f1-4747-8553-3a471be6e9e1 req-79c2f4ce-c6f7-4c39-b5db-18b32c8c6125 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:02.623332 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-55042962-d0f1-4747-8553-3a471be6e9e1 req-79c2f4ce-c6f7-4c39-b5db-18b32c8c6125 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 947 time: 0.0570862 Dec 09 14:47:02.675946 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-55042962-d0f1-4747-8553-3a471be6e9e1 req-c465c234-8f89-49f7-9442-efca9f24911f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463839 Dec 09 14:47:02.802487 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c933513-79f1-4f52-b753-8eb9115a6199 req-4877bf2e-c01e-4fa3-ac02-19f3d8c0c877 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:02.803936 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6c933513-79f1-4f52-b753-8eb9115a6199 req-4877bf2e-c01e-4fa3-ac02-19f3d8c0c877 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 945 time: 0.0497079 Dec 09 14:47:02.850739 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6c933513-79f1-4f52-b753-8eb9115a6199 req-65bf399a-abd3-4462-8e64-344297f234af tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407100 Dec 09 14:47:03.467767 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e231e7e-2dd7-42f1-b6ee-ed135d196de1 req-210d89b9-2949-485a-aeb2-0118a16c034f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:03.469269 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3e231e7e-2dd7-42f1-b6ee-ed135d196de1 req-210d89b9-2949-485a-aeb2-0118a16c034f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0515141 Dec 09 14:47:03.529588 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3e231e7e-2dd7-42f1-b6ee-ed135d196de1 req-4d4d2c04-b4c1-429d-b1f7-de0ead956267 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0542176 Dec 09 14:47:03.830892 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd06fcd1-2371-4c9d-bd67-38558b1bfd05 req-1eefdd3e-2119-46e6-bb3e-cf49adf4607b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:03.832303 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fd06fcd1-2371-4c9d-bd67-38558b1bfd05 req-1eefdd3e-2119-46e6-bb3e-cf49adf4607b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 947 time: 0.0631721 Dec 09 14:47:03.879990 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fd06fcd1-2371-4c9d-bd67-38558b1bfd05 req-8e5b329e-7a0f-4507-a9f9-b50b7f7b6157 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=0305423b-9ab7-48eb-b33a-bd8e33378735&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415959 Dec 09 14:47:03.967866 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79c3ee9c-c301-4af0-b27c-76004bde7c44 req-6d16b0b2-6034-44ab-aa7f-2015f28308cd tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:03.969393 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-79c3ee9c-c301-4af0-b27c-76004bde7c44 req-6d16b0b2-6034-44ab-aa7f-2015f28308cd tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 945 time: 0.0497639 Dec 09 14:47:04.017109 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-79c3ee9c-c301-4af0-b27c-76004bde7c44 req-40285e66-7707-40d3-9644-58ddee3e0e12 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416460 Dec 09 14:47:04.240815 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-3d77b7fd-c2e1-41b5-9d2b-e6ec21973908 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:04.242166 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-3d77b7fd-c2e1-41b5-9d2b-e6ec21973908 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.44 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 947 time: 0.0608089 Dec 09 14:47:04.337307 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-0e98511b-e527-4aad-a395-9198ed300858 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Deleting port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:47:04.337654 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-0e98511b-e527-4aad-a395-9198ed300858 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:04.430105 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-0e98511b-e527-4aad-a395-9198ed300858 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] For port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:47:04.430478 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-0e98511b-e527-4aad-a395-9198ed300858 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:04.648728 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1886bcb8-0c9f-4724-acf3-e9b38a80beff req-96d2ec6a-7e35-416b-967d-13565c53396f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:04.650334 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1886bcb8-0c9f-4724-acf3-e9b38a80beff req-96d2ec6a-7e35-416b-967d-13565c53396f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0486100 Dec 09 14:47:04.660968 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-0e98511b-e527-4aad-a395-9198ed300858 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:04.661335 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-0e98511b-e527-4aad-a395-9198ed300858 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:04.661650 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.l3_db [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-0e98511b-e527-4aad-a395-9198ed300858 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Floating IP dd85f982-92bb-456b-a1d1-1eb7afd674e2 disassociated. External IP: 172.27.0.157, port: eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7. Dec 09 14:47:04.661999 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-0e98511b-e527-4aad-a395-9198ed300858 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Calling delete_port for eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:47:04.697718 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1886bcb8-0c9f-4724-acf3-e9b38a80beff req-a0dd9f5e-8762-4e5e-81ea-9b9ebe026e0a tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413072 Dec 09 14:47:04.793532 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-0e98511b-e527-4aad-a395-9198ed300858 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:04.824533 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e98511b-e527-4aad-a395-9198ed300858 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event deleted for resources: {'Port': ['ID=eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:04.939435 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-0e98511b-e527-4aad-a395-9198ed300858 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:47:05.011295 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-aa4fc4f6-f93c-462c-a9da-a24175f0ac8b req-4aac43c1-8677-4fad-97f7-b66da1156a5a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=a8ee2ec0-d1d7-458d-ae2a-509098efff13 HTTP/1.1" status: 200 len: 210 time: 0.0305517 Dec 09 14:47:05.071928 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-0e98511b-e527-4aad-a395-9198ed300858 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:47:05.085338 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef0516b8-6c15-4511-b494-1cbce6f86339 None None] Sync routers for ids ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:47:05.095228 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef0516b8-6c15-4511-b494-1cbce6f86339 None None] Routers {'49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:47:05.096142 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-ef0516b8-6c15-4511-b494-1cbce6f86339 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:46:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:47:05.112367 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-0e98511b-e527-4aad-a395-9198ed300858 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] No DVR routers for this DVR port eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:47:05.117547 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-0e98511b-e527-4aad-a395-9198ed300858 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:05.121720 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33f9d334-0d88-4e54-9998-a16f44d4c702 req-0e98511b-e527-4aad-a395-9198ed300858 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.44 "DELETE /v2.0/ports/eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 HTTP/1.1" status: 204 len: 173 time: 0.8716636 Dec 09 14:47:05.122304 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'name': 'network-vif-deleted', 'tag': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:47:05.124765 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a090a528-e610-4ec5-958d-7fcec8875417" -d '{"events": [{"server_uuid": "a8ee2ec0-d1d7-458d-ae2a-509098efff13", "name": "network-vif-deleted", "tag": "eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:47:05.174921 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:47:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1590953b-28eb-4f31-930c-cc18a1941b50 x-openstack-request-id: req-1590953b-28eb-4f31-930c-cc18a1941b50 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:47:05.175427 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a8ee2ec0-d1d7-458d-ae2a-509098efff13", "name": "network-vif-deleted", "tag": "eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:47:05.175925 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-1590953b-28eb-4f31-930c-cc18a1941b50 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:47:05.176347 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a8ee2ec0-d1d7-458d-ae2a-509098efff13', 'name': 'network-vif-deleted', 'tag': 'eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7', 'status': 'completed', 'code': 200} Dec 09 14:47:05.188827 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a847d1a-5e5b-4066-88bd-0feb6cde7134 req-831977a4-9791-4d8b-a91e-285a9711ff2b tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:05.191298 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8a847d1a-5e5b-4066-88bd-0feb6cde7134 req-831977a4-9791-4d8b-a91e-285a9711ff2b tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 945 time: 0.0894990 Dec 09 14:47:05.221340 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-ef0516b8-6c15-4511-b494-1cbce6f86339 None None] Set router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:47:05.255119 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8a847d1a-5e5b-4066-88bd-0feb6cde7134 req-e60751c1-4da1-4ca6-a3b7-54e3822d65b0 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543666 Dec 09 14:47:05.419742 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-ef0516b8-6c15-4511-b494-1cbce6f86339 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '6db4124e-4bda-4bda-b604-9b9706732691', 'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'mac_address': 'fa:16:3e:7f:fb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 5, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'subnets': [{'id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:47:05.449678 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef0516b8-6c15-4511-b494-1cbce6f86339 None None] Checking router: 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:47:05.458447 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef0516b8-6c15-4511-b494-1cbce6f86339 None None] Routers {'49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:47:05.459056 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-ef0516b8-6c15-4511-b494-1cbce6f86339 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:46:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:47:05.565053 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-ef0516b8-6c15-4511-b494-1cbce6f86339 None None] Set router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:47:05.816104 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-ef0516b8-6c15-4511-b494-1cbce6f86339 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '6db4124e-4bda-4bda-b604-9b9706732691', 'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'mac_address': 'fa:16:3e:7f:fb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 5, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'subnets': [{'id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:47:05.825948 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e031877-b58f-490f-b3a1-ed31338d7234 req-c5c43ae2-8e12-407e-b508-6cd19c70af04 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:05.828409 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9e031877-b58f-490f-b3a1-ed31338d7234 req-c5c43ae2-8e12-407e-b508-6cd19c70af04 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.44 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 945 time: 0.1110902 Dec 09 14:47:05.878013 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ef0516b8-6c15-4511-b494-1cbce6f86339 None None] The sync data for ids ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'] in dv-cinder-819692-8-iscsi is: [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '6db4124e-4bda-4bda-b604-9b9706732691', 'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'mac_address': 'fa:16:3e:7f:fb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 5, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'subnets': [{'id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:47:05.936057 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e95f2a0a-988d-48ad-9d67-a7710d1b044f req-dfc46b07-5775-45a0-a8d3-0100431ae569 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:05.937765 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e95f2a0a-988d-48ad-9d67-a7710d1b044f req-dfc46b07-5775-45a0-a8d3-0100431ae569 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.1468046 Dec 09 14:47:05.997876 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-9e031877-b58f-490f-b3a1-ed31338d7234 req-e7515352-9c33-41fd-b6a6-8fc90db5e56d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Deleting port 0f2f1781-649a-4354-970b-2a44213cf1b4 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:47:05.998246 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-9e031877-b58f-490f-b3a1-ed31338d7234 req-e7515352-9c33-41fd-b6a6-8fc90db5e56d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:06.064569 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e95f2a0a-988d-48ad-9d67-a7710d1b044f req-cd5d02e3-888d-42e1-9dd7-7d6315a62d6d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1136410 Dec 09 14:47:06.130647 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58566) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:06.169285 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-9e031877-b58f-490f-b3a1-ed31338d7234 req-e7515352-9c33-41fd-b6a6-8fc90db5e56d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] For port 0f2f1781-649a-4354-970b-2a44213cf1b4, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0f2f1781-649a-4354-970b-2a44213cf1b4,segment=NetworkSegment(e2f74911-9ec7-4d46-b689-ab5ae0cbb567),segment_id=e2f74911-9ec7-4d46-b689-ab5ae0cbb567)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:47:06.169924 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-9e031877-b58f-490f-b3a1-ed31338d7234 req-e7515352-9c33-41fd-b6a6-8fc90db5e56d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:06.189347 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-9e031877-b58f-490f-b3a1-ed31338d7234 req-e7515352-9c33-41fd-b6a6-8fc90db5e56d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Calling delete_port for 0f2f1781-649a-4354-970b-2a44213cf1b4 owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:47:06.200871 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-78b9ad62-9ffb-4ac7-8da2-051e19674fec tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:06.233636 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-78b9ad62-9ffb-4ac7-8da2-051e19674fec tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:06.302638 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-18665a77-babd-4729-899d-28bd2127f5f5 None None] New status for floating IP dd85f982-92bb-456b-a1d1-1eb7afd674e2: DOWN {{(pid=109064) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:47:06.309331 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-78b9ad62-9ffb-4ac7-8da2-051e19674fec tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:06.312223 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-78b9ad62-9ffb-4ac7-8da2-051e19674fec tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:06.315907 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-78b9ad62-9ffb-4ac7-8da2-051e19674fec tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "DELETE /v2.0/security-groups/0305423b-9ab7-48eb-b33a-bd8e33378735 HTTP/1.1" status: 204 len: 168 time: 0.1817188 Dec 09 14:47:06.318047 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58576) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:06.345179 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.api.v2.resource [None req-f4fe531b-ead0-432b-ac74-b0684ebba374 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] show failed (client error): The resource could not be found. Dec 09 14:47:06.348912 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-f4fe531b-ead0-432b-ac74-b0684ebba374 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups/0305423b-9ab7-48eb-b33a-bd8e33378735 HTTP/1.1" status: 404 len: 347 time: 0.0272460 Dec 09 14:47:06.373637 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58578) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:06.382642 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78b9ad62-9ffb-4ac7-8da2-051e19674fec tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0305423b-9ab7-48eb-b33a-bd8e33378735,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:06.400685 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-9e031877-b58f-490f-b3a1-ed31338d7234 req-e7515352-9c33-41fd-b6a6-8fc90db5e56d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:06.413867 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['0f2f1781-649a-4354-970b-2a44213cf1b4'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:47:06.444478 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7515352-9c33-41fd-b6a6-8fc90db5e56d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Pushing event deleted for resources: {'Port': ['ID=0f2f1781-649a-4354-970b-2a44213cf1b4,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:06.459912 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fa43d94-7d13-4b95-a5f4-6e27efd491d2 req-b9e20fcf-4ddb-46f9-8b1f-ca0bd8a78318 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:06.461473 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1fa43d94-7d13-4b95-a5f4-6e27efd491d2 req-b9e20fcf-4ddb-46f9-8b1f-ca0bd8a78318 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/ports?device_id=7cee90e4-4ab9-4ff3-865b-7c84761d82c9 HTTP/1.1" status: 200 len: 867 time: 0.1140547 Dec 09 14:47:06.492839 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-9e031877-b58f-490f-b3a1-ed31338d7234 req-e7515352-9c33-41fd-b6a6-8fc90db5e56d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] No DVR routers for this DVR port 0f2f1781-649a-4354-970b-2a44213cf1b4 on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:47:06.496557 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-9e031877-b58f-490f-b3a1-ed31338d7234 req-e7515352-9c33-41fd-b6a6-8fc90db5e56d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:06.501805 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9e031877-b58f-490f-b3a1-ed31338d7234 req-e7515352-9c33-41fd-b6a6-8fc90db5e56d tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.44 "DELETE /v2.0/ports/0f2f1781-649a-4354-970b-2a44213cf1b4 HTTP/1.1" status: 204 len: 173 time: 0.6497438 Dec 09 14:47:06.569093 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1fa43d94-7d13-4b95-a5f4-6e27efd491d2 req-d2625946-9fd6-4047-bee8-99a0aa342428 tempest-VolumesSnapshotTestJSON-1465621809 tempest-VolumesSnapshotTestJSON-1465621809-project] 10.222.0.39 "GET /v2.0/security-groups?id=c07b8fd5-6306-4357-a7fe-deb9f81df7ba&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797904 Dec 09 14:47:06.589149 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-defc92d2-249f-480b-a82a-57aed9b77b64 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Deleting port bd7b5fa1-313f-4c93-b03c-98217d4feefd {{(pid=109062) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:47:06.589369 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-defc92d2-249f-480b-a82a-57aed9b77b64 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:06.689328 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-defc92d2-249f-480b-a82a-57aed9b77b64 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:06.689652 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-defc92d2-249f-480b-a82a-57aed9b77b64 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:06.702996 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-defc92d2-249f-480b-a82a-57aed9b77b64 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Calling delete_port for bd7b5fa1-313f-4c93-b03c-98217d4feefd owned by network:floatingip {{(pid=109062) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:47:06.853532 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-defc92d2-249f-480b-a82a-57aed9b77b64 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:06.879952 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-defc92d2-249f-480b-a82a-57aed9b77b64 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event deleted for resources: {'Port': ['ID=bd7b5fa1-313f-4c93-b03c-98217d4feefd,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:06.950119 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-defc92d2-249f-480b-a82a-57aed9b77b64 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for floatingip, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:06.952730 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-defc92d2-249f-480b-a82a-57aed9b77b64 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:06.957105 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-defc92d2-249f-480b-a82a-57aed9b77b64 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "DELETE /v2.0/floatingips/dd85f982-92bb-456b-a1d1-1eb7afd674e2 HTTP/1.1" status: 204 len: 168 time: 0.5765355 Dec 09 14:47:07.177331 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7cee90e4-4ab9-4ff3-865b-7c84761d82c9', 'name': 'network-vif-deleted', 'tag': '0f2f1781-649a-4354-970b-2a44213cf1b4'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:47:07.179751 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3057afa0-fecd-420a-8eae-8fd41bcd8942" -d '{"events": [{"server_uuid": "7cee90e4-4ab9-4ff3-865b-7c84761d82c9", "name": "network-vif-deleted", "tag": "0f2f1781-649a-4354-970b-2a44213cf1b4"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:47:07.186444 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73b9cda4-e18c-478b-ae78-43c3ebb83b77 req-40858a5a-937b-43f6-81c5-3069d580262f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:07.188012 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-73b9cda4-e18c-478b-ae78-43c3ebb83b77 req-40858a5a-937b-43f6-81c5-3069d580262f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0501266 Dec 09 14:47:07.234540 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-73b9cda4-e18c-478b-ae78-43c3ebb83b77 req-29af1041-528b-4f3c-b9dd-a6cf18c222fe tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400798 Dec 09 14:47:07.278916 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:47:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-395661ee-88c5-4020-8e7c-4f7d91a00807 x-openstack-request-id: req-395661ee-88c5-4020-8e7c-4f7d91a00807 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:47:07.279246 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7cee90e4-4ab9-4ff3-865b-7c84761d82c9", "name": "network-vif-deleted", "tag": "0f2f1781-649a-4354-970b-2a44213cf1b4", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:47:07.279506 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-395661ee-88c5-4020-8e7c-4f7d91a00807 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:47:07.279955 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7cee90e4-4ab9-4ff3-865b-7c84761d82c9', 'name': 'network-vif-deleted', 'tag': '0f2f1781-649a-4354-970b-2a44213cf1b4', 'status': 'completed', 'code': 200} Dec 09 14:47:07.346421 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58590) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:07.351245 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-75603326-b5cd-46e4-8bcb-5997b001bcdb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1320041924', 'description': 'tempest-description--850303123'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:47:07.376491 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-75603326-b5cd-46e4-8bcb-5997b001bcdb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:07.443681 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-75603326-b5cd-46e4-8bcb-5997b001bcdb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:07.448469 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-75603326-b5cd-46e4-8bcb-5997b001bcdb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:07.479794 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-75603326-b5cd-46e4-8bcb-5997b001bcdb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:07.480937 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-75603326-b5cd-46e4-8bcb-5997b001bcdb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1334879 Dec 09 14:47:07.482092 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-75603326-b5cd-46e4-8bcb-5997b001bcdb tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a6124e5d-ba62-478d-8349-5dc52bb5776b,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:07.484327 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 58594) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:07.495060 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-561c1cf3-d052-40b9-bae1-8ad9a27dd319 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Request body: {'security_group_rule': {'security_group_id': 'a6124e5d-ba62-478d-8349-5dc52bb5776b', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:47:07.532172 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-561c1cf3-d052-40b9-bae1-8ad9a27dd319 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:07.572913 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:47:07.593785 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:47:07.594129 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device eb1c8f3f-27cc-40d4-a6a5-9b6aa49890f7 not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:47:07.602440 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-561c1cf3-d052-40b9-bae1-8ad9a27dd319 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:07.608303 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-561c1cf3-d052-40b9-bae1-8ad9a27dd319 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:07.630377 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-561c1cf3-d052-40b9-bae1-8ad9a27dd319 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=03a08e44-4c36-433e-8e74-03aa7047060b,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:07.637493 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-561c1cf3-d052-40b9-bae1-8ad9a27dd319 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:07.638781 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-561c1cf3-d052-40b9-bae1-8ad9a27dd319 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1533885 Dec 09 14:47:07.647132 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 58598) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:07.647132 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-e090946f-78ce-445c-a6cf-13b66ee8a8c5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Request body: {'security_group_rule': {'security_group_id': 'a6124e5d-ba62-478d-8349-5dc52bb5776b', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:47:07.674374 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e090946f-78ce-445c-a6cf-13b66ee8a8c5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:07.734173 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e090946f-78ce-445c-a6cf-13b66ee8a8c5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:07.740923 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e090946f-78ce-445c-a6cf-13b66ee8a8c5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:07.762256 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e090946f-78ce-445c-a6cf-13b66ee8a8c5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2cd12a81-a23b-47e1-aeb9-76184a350b00,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:07.782683 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e090946f-78ce-445c-a6cf-13b66ee8a8c5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:07.783987 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-e090946f-78ce-445c-a6cf-13b66ee8a8c5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1408739 Dec 09 14:47:07.787241 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 58604) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:07.792329 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Request body: {'floatingip': {'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:47:07.819578 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for floatingip, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:07.921473 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:08.027981 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Allocated IP 172.27.0.254 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/4d79fcac-a2ad-4d97-a6bc-48df80cd54bf) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:47:08.136349 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:08.175706 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:08.216325 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:47:08.221066 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:47:08.224554 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:47:08.229973 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event updated for resources: {'Port': ['ID=4d79fcac-a2ad-4d97-a6bc-48df80cd54bf,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:08.344497 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:08.387651 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe71116e-5d09-42af-a679-4f1afedc923b req-d06cf6f6-c5a4-4419-904b-d1eff91b5f73 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:08.389272 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fe71116e-5d09-42af-a679-4f1afedc923b req-d06cf6f6-c5a4-4419-904b-d1eff91b5f73 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0801547 Dec 09 14:47:08.401109 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:08.438483 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:47:08.473231 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fe71116e-5d09-42af-a679-4f1afedc923b req-8a9806c1-d3c8-47dd-b90e-2e91eeb3b595 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0778048 Dec 09 14:47:08.580602 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:08.586572 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:08.655349 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event updated for resources: {'Port': ['ID=4d79fcac-a2ad-4d97-a6bc-48df80cd54bf,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:08.668764 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:08.679899 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 58616) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:08.688745 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:08.689928 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-23b6295b-b8a7-4035-ac03-285f3c07d71d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.9015584 Dec 09 14:47:08.786239 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e22240c9-186e-44ba-bb1f-f459709b02e3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:08.863263 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e22240c9-186e-44ba-bb1f-f459709b02e3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:08.869050 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e22240c9-186e-44ba-bb1f-f459709b02e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:08.893055 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-76cc473f-c938-4be5-81b3-4d643131c6d5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?name=tempest-securitygroup--1320041924&fields=id&tenant_id=6be5d78d2d0049448c3947b4e650758a HTTP/1.1" status: 200 len: 267 time: 0.0493300 Dec 09 14:47:08.912151 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-e22240c9-186e-44ba-bb1f-f459709b02e3 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=07e80082954c4d77ae1bcb5b86e2e5b8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2310467 Dec 09 14:47:08.913075 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e22240c9-186e-44ba-bb1f-f459709b02e3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=039268ba-1a31-4f7b-81a2-03d223e4c4de,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:08.916241 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58636) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:09.030423 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-72e8e6d1-67b3-425c-8eac-01eb88ad620e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:09.056745 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-295d1c1d-3132-4cff-9a3a-d40657c5c437 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:09.058229 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-295d1c1d-3132-4cff-9a3a-d40657c5c437 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/networks?id=9ab3f8b6-44d0-4210-907d-0e96072c4566 HTTP/1.1" status: 200 len: 816 time: 0.1568685 Dec 09 14:47:09.079834 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-72e8e6d1-67b3-425c-8eac-01eb88ad620e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:09.091237 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-abe2ab09-a1a6-478b-956a-710a7301890a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/quotas/6be5d78d2d0049448c3947b4e650758a HTTP/1.1" status: 200 len: 375 time: 0.0254993 Dec 09 14:47:09.156601 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-d12d64a2-427b-4423-8e9c-e1ec3e1b19de tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=6be5d78d2d0049448c3947b4e650758a&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0587430 Dec 09 14:47:09.162096 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-72e8e6d1-67b3-425c-8eac-01eb88ad620e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:09.164668 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-72e8e6d1-67b3-425c-8eac-01eb88ad620e admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:09.165738 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-72e8e6d1-67b3-425c-8eac-01eb88ad620e admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/039268ba-1a31-4f7b-81a2-03d223e4c4de HTTP/1.1" status: 204 len: 168 time: 0.2380357 Dec 09 14:47:09.181793 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72e8e6d1-67b3-425c-8eac-01eb88ad620e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=039268ba-1a31-4f7b-81a2-03d223e4c4de,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:09.257685 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-d979f21b-f6ff-498f-a0e0-78b610f2c8d4 service neutron] 10.222.0.39 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893137 Dec 09 14:47:09.346733 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-26d99223-c80f-4558-8d13-d6b41d38fdac service neutron] 10.222.0.39 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0824702 Dec 09 14:47:09.439684 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58644) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:09.460858 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7b7f5955-6137-4711-95de-30230ab3645a admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:09.528475 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d9ebd682-259f-43d6-986b-f10723c9b31a req-3191349d-da51-4f9f-a73a-75a5eaf4ef5c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 210 time: 0.0385509 Dec 09 14:47:09.588219 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7b7f5955-6137-4711-95de-30230ab3645a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:09.595188 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-7b7f5955-6137-4711-95de-30230ab3645a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:09.881013 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb8d273-a90c-49f3-a60d-7947ac8d5e30 req-f786423a-baa0-4ef6-9305-fe48ef701ee4 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:09.882469 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-dfb8d273-a90c-49f3-a60d-7947ac8d5e30 req-f786423a-baa0-4ef6-9305-fe48ef701ee4 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.3278651 Dec 09 14:47:09.885724 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b7f5955-6137-4711-95de-30230ab3645a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=22f390f0-8194-4a5f-9344-024dd63b84c6,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:09.889916 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-7b7f5955-6137-4711-95de-30230ab3645a admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=58ab5b6f53a541a89a53b8963162e570&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4490256 Dec 09 14:47:09.893635 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 58658) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:09.934897 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-dfb8d273-a90c-49f3-a60d-7947ac8d5e30 req-edf03886-ce3f-41dc-8a18-c9e9cc0108d8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434504 Dec 09 14:47:09.944664 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-27fd5494-5b34-4e1e-a981-9b6c2f4e3750 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:09.966701 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-27fd5494-5b34-4e1e-a981-9b6c2f4e3750 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:10.015002 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-27fd5494-5b34-4e1e-a981-9b6c2f4e3750 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:10.017772 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-27fd5494-5b34-4e1e-a981-9b6c2f4e3750 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:10.019220 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-27fd5494-5b34-4e1e-a981-9b6c2f4e3750 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/22f390f0-8194-4a5f-9344-024dd63b84c6 HTTP/1.1" status: 204 len: 168 time: 0.1241465 Dec 09 14:47:10.027054 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27fd5494-5b34-4e1e-a981-9b6c2f4e3750 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=22f390f0-8194-4a5f-9344-024dd63b84c6,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:10.256820 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 0f2f1781-649a-4354-970b-2a44213cf1b4 no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:47:10.279850 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: 0f2f1781-649a-4354-970b-2a44213cf1b4 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:47:10.280199 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 0f2f1781-649a-4354-970b-2a44213cf1b4 not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:47:10.625212 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c0607ec0-fbb4-44b2-96b9-6961c6ad60b3 req-e64c96f8-1718-4355-9170-6c57f02cc7d7 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 210 time: 0.0269053 Dec 09 14:47:11.052043 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-242e987b-b1e2-4d85-b1ec-7e6ab7199a8c req-06c131bc-f1f9-498a-a7a4-3187f518ffaa tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:11.053589 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-242e987b-b1e2-4d85-b1ec-7e6ab7199a8c req-06c131bc-f1f9-498a-a7a4-3187f518ffaa tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0498092 Dec 09 14:47:11.099945 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-242e987b-b1e2-4d85-b1ec-7e6ab7199a8c req-0dfd0e46-c091-44f7-ac0e-aca035d2457a tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400686 Dec 09 14:47:11.732958 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3e47f681-c695-4ae4-913a-800b4488baa7 req-8ece5d58-d97d-45c7-b509-24a84fe79f29 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 210 time: 0.0332813 Dec 09 14:47:12.230848 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d79f0c3-dd31-46d6-90a1-1da569c740ac req-b05be04e-7e7f-4668-abf7-d239418f2352 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:12.232386 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5d79f0c3-dd31-46d6-90a1-1da569c740ac req-b05be04e-7e7f-4668-abf7-d239418f2352 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0574334 Dec 09 14:47:12.285202 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5d79f0c3-dd31-46d6-90a1-1da569c740ac req-67998711-a102-4ed8-88d7-f2b9405e6ba8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463128 Dec 09 14:47:12.815758 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-2f9ab23d-ae7c-4f80-95bf-a8d281cd244a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:12.818090 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-2f9ab23d-ae7c-4f80-95bf-a8d281cd244a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.44 "GET /v2.0/networks?id=9ab3f8b6-44d0-4210-907d-0e96072c4566 HTTP/1.1" status: 200 len: 816 time: 0.1197655 Dec 09 14:47:12.858915 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-76218d44-c0d9-4f4e-bb5f-76af70d23b0c req-bde66f20-2105-4c9d-9af5-9197e0f87d56 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 210 time: 0.0369492 Dec 09 14:47:12.918009 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-8a9312a4-b419-4a05-a1d3-a4b56e897b0c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.44 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6be5d78d2d0049448c3947b4e650758a HTTP/1.1" status: 200 len: 380 time: 0.0865970 Dec 09 14:47:12.928962 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-08d02cef-c961-4bcc-8e2a-701ba55aac38 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Request body: {'port': {'device_id': '496052b6-9737-4680-bcd6-64721946b1a4', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'admin_state_up': True, 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'security_groups': ['a6124e5d-ba62-478d-8349-5dc52bb5776b']}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:47:13.041498 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-08d02cef-c961-4bcc-8e2a-701ba55aac38 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Made reservation on behalf of 6be5d78d2d0049448c3947b4e650758a for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:47:13.045114 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-08d02cef-c961-4bcc-8e2a-701ba55aac38 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:13.178611 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-08d02cef-c961-4bcc-8e2a-701ba55aac38 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Allocated IP 172.20.0.13 (9ab3f8b6-44d0-4210-907d-0e96072c4566/f10f1097-5d43-4737-bcac-a27ade66b442/d37591e8-0953-4fbc-9688-71f4c813e43c) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:47:13.317799 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-08d02cef-c961-4bcc-8e2a-701ba55aac38 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:13.365390 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-08d02cef-c961-4bcc-8e2a-701ba55aac38 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:13.408929 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-375c01a8-54b4-4353-bcea-c00d5851c45a req-7a699557-3fa4-4c27-b3aa-4b77ee05cf52 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:13.409785 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-08d02cef-c961-4bcc-8e2a-701ba55aac38 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Network 9ab3f8b6-44d0-4210-907d-0e96072c4566 is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:47:13.410695 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-375c01a8-54b4-4353-bcea-c00d5851c45a req-7a699557-3fa4-4c27-b3aa-4b77ee05cf52 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0504656 Dec 09 14:47:13.413500 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-08d02cef-c961-4bcc-8e2a-701ba55aac38 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:47:13.417251 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-08d02cef-c961-4bcc-8e2a-701ba55aac38 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:47:13.462542 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08d02cef-c961-4bcc-8e2a-701ba55aac38 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event updated for resources: {'Port': ['ID=d37591e8-0953-4fbc-9688-71f4c813e43c,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:13.474808 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-375c01a8-54b4-4353-bcea-c00d5851c45a req-20225698-d830-4ff3-bef4-83ff4085b217 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0563114 Dec 09 14:47:13.490234 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-08d02cef-c961-4bcc-8e2a-701ba55aac38 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:13.490876 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-08d02cef-c961-4bcc-8e2a-701ba55aac38 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:13.508704 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-08d02cef-c961-4bcc-8e2a-701ba55aac38 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5834315 Dec 09 14:47:13.522077 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Request body: {'port': {'device_id': '496052b6-9737-4680-bcd6-64721946b1a4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:47:13.577170 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:13.664482 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-59a559aa-6ffa-412f-b1eb-bd8dc960febe None None] Provisioning complete for port d37591e8-0953-4fbc-9688-71f4c813e43c triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:47:13.665122 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-59a559aa-6ffa-412f-b1eb-bd8dc960febe None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:13.702291 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-59a559aa-6ffa-412f-b1eb-bd8dc960febe None None] Port d37591e8-0953-4fbc-9688-71f4c813e43c cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:47:14.037165 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793b18a2-52d6-41e9-ae8f-a558b2bb3fcb req-a3856c9f-d56b-42b5-ac86-196d575134b8 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:14.038640 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-793b18a2-52d6-41e9-ae8f-a558b2bb3fcb req-a3856c9f-d56b-42b5-ac86-196d575134b8 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 932 time: 0.1018519 Dec 09 14:47:14.134723 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-793b18a2-52d6-41e9-ae8f-a558b2bb3fcb req-9491c9e9-7b4c-434b-ab0e-31b88075aab5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0894704 Dec 09 14:47:14.150512 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d37591e8-0953-4fbc-9688-71f4c813e43c {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:47:14.158624 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:14.172204 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Transition to ACTIVE for port object d37591e8-0953-4fbc-9688-71f4c813e43c will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:47:14.176868 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:14.230819 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Pushing event updated for resources: {'Port': ['ID=d37591e8-0953-4fbc-9688-71f4c813e43c,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:14.305950 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Attempting to bind port d37591e8-0953-4fbc-9688-71f4c813e43c on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:47:14.306298 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Attempting to bind port d37591e8-0953-4fbc-9688-71f4c813e43c by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:47:14.306670 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Attempting to bind port d37591e8-0953-4fbc-9688-71f4c813e43c on network 9ab3f8b6-44d0-4210-907d-0e96072c4566 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:47:14.311375 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Port d37591e8-0953-4fbc-9688-71f4c813e43c on network 9ab3f8b6-44d0-4210-907d-0e96072c4566 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:47:14.311752 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Attempting to bind port d37591e8-0953-4fbc-9688-71f4c813e43c on network 9ab3f8b6-44d0-4210-907d-0e96072c4566 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:47:14.316979 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 46, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:47:14.317334 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Checking segment: {'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:47:14.317783 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Bound using segment: {'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:47:14.318221 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Bound port: d37591e8-0953-4fbc-9688-71f4c813e43c, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1adee164-28a6-4213-83dc-d46a3aca10ed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 412, 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:47:14.318587 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:14.389557 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] For port d37591e8-0953-4fbc-9688-71f4c813e43c, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:47:14.393484 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] For port d37591e8-0953-4fbc-9688-71f4c813e43c, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=d37591e8-0953-4fbc-9688-71f4c813e43c,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:47:14.399701 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:14.450718 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:14.451447 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:14.453201 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] 10.222.0.44 "PUT /v2.0/ports/d37591e8-0953-4fbc-9688-71f4c813e43c HTTP/1.1" status: 200 len: 1094 time: 0.9353707 Dec 09 14:47:14.453836 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '496052b6-9737-4680-bcd6-64721946b1a4', 'tag': 'd37591e8-0953-4fbc-9688-71f4c813e43c'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:47:14.456636 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-90ea18ae-26dc-4d70-a0d9-ac2e12b950e4" -d '{"events": [{"name": "network-changed", "server_uuid": "496052b6-9737-4680-bcd6-64721946b1a4", "tag": "d37591e8-0953-4fbc-9688-71f4c813e43c"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:47:14.463372 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58774) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:14.478985 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d8ff4f4-3d65-447c-a77a-6aee34d4ac3a service neutron] Pushing event updated for resources: {'Port': ['ID=d37591e8-0953-4fbc-9688-71f4c813e43c,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:14.542204 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:47:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-71e25bda-ccf1-4fb3-8f80-830dd6d1fd5b x-openstack-request-id: req-71e25bda-ccf1-4fb3-8f80-830dd6d1fd5b {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:47:14.542570 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "496052b6-9737-4680-bcd6-64721946b1a4", "tag": "d37591e8-0953-4fbc-9688-71f4c813e43c", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:47:14.542782 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-71e25bda-ccf1-4fb3-8f80-830dd6d1fd5b {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:47:14.543229 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '496052b6-9737-4680-bcd6-64721946b1a4', 'tag': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'status': 'completed', 'code': 200} Dec 09 14:47:14.616935 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3f0f8b47-222d-43f9-8ecf-a1e383a1097b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:14.618613 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-3f0f8b47-222d-43f9-8ecf-a1e383a1097b service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=6be5d78d2d0049448c3947b4e650758a&device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 1097 time: 0.1071181 Dec 09 14:47:14.646978 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-11206411-ce30-432b-964e-4ae06d2cc586 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:14.672648 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-78650093-e9af-4aee-9bb5-1070f64bcabf service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d37591e8-0953-4fbc-9688-71f4c813e43c HTTP/1.1" status: 200 len: 217 time: 0.0442483 Dec 09 14:47:14.680563 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7111f519-a75d-4ddc-af5b-1cbbaf12245d req-4dca9ffa-0e40-4268-a741-6969458d304d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:14.682080 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7111f519-a75d-4ddc-af5b-1cbbaf12245d req-4dca9ffa-0e40-4268-a741-6969458d304d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.1044331 Dec 09 14:47:14.730994 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-11206411-ce30-432b-964e-4ae06d2cc586 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:14.737568 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-11206411-ce30-432b-964e-4ae06d2cc586 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:14.751401 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-152aebb0-efb9-426d-820b-5bfa93574684 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:14.752842 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-152aebb0-efb9-426d-820b-5bfa93574684 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=f10f1097-5d43-4737-bcac-a27ade66b442 HTTP/1.1" status: 200 len: 855 time: 0.0698290 Dec 09 14:47:14.776032 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7111f519-a75d-4ddc-af5b-1cbbaf12245d req-a5d37a7f-1577-43c9-acbf-a9d660133bbc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0838535 Dec 09 14:47:14.778325 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-11206411-ce30-432b-964e-4ae06d2cc586 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=f5c99e906b0448f2bdb5405928b8fba2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3134634 Dec 09 14:47:14.779141 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58782) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:14.785675 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11206411-ce30-432b-964e-4ae06d2cc586 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=73de519a-34a4-46d8-af49-e132a8b1f1fa,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:14.805794 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-6706689e-fb90-4be3-9ba2-70f3f6d65f24 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:14.807316 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-6706689e-fb90-4be3-9ba2-70f3f6d65f24 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=9ab3f8b6-44d0-4210-907d-0e96072c4566&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0472300 Dec 09 14:47:14.824351 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:14.841871 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-30329e59-c73a-483d-b64c-cade660ad28f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:14.865237 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-30329e59-c73a-483d-b64c-cade660ad28f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:14.926181 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-ebbbb6ef-7948-4dfc-9b67-64a68b6053ff service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1106548 Dec 09 14:47:14.932105 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-30329e59-c73a-483d-b64c-cade660ad28f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:14.934976 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-30329e59-c73a-483d-b64c-cade660ad28f admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:14.936248 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-30329e59-c73a-483d-b64c-cade660ad28f admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/73de519a-34a4-46d8-af49-e132a8b1f1fa HTTP/1.1" status: 204 len: 168 time: 0.1556208 Dec 09 14:47:14.944879 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30329e59-c73a-483d-b64c-cade660ad28f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=73de519a-34a4-46d8-af49-e132a8b1f1fa,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:15.095123 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0851aa4c-bfd8-4a78-8b96-573a9062b33a req-f1426967-383d-4de0-9547-782dfb666255 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:15.096624 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0851aa4c-bfd8-4a78-8b96-573a9062b33a req-f1426967-383d-4de0-9547-782dfb666255 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.1098063 Dec 09 14:47:15.105368 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6e61385f-982e-4085-b773-d2ced4cdda67 req-8c1a83f9-156e-4d42-a5b3-9deec784f821 service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1716809 Dec 09 14:47:15.141943 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e6f617-029c-4b11-aba7-493f3103bbe7 req-c015c79c-4023-4964-8608-a00fcb6d4551 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:15.143432 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-18e6f617-029c-4b11-aba7-493f3103bbe7 req-c015c79c-4023-4964-8608-a00fcb6d4551 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=a538bf01cb5440ffa06b6873f212efaa&device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 1098 time: 0.0890322 Dec 09 14:47:15.185347 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0851aa4c-bfd8-4a78-8b96-573a9062b33a req-c066718d-e868-4dcf-ac63-fbd774021cd7 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0822082 Dec 09 14:47:15.247073 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 58796) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:15.265905 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ea18ae-26dc-4d70-a0d9-ac2e12b950e4 req-bfde919d-02e8-429f-98a7-ffa4f484edd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:15.267416 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-90ea18ae-26dc-4d70-a0d9-ac2e12b950e4 req-bfde919d-02e8-429f-98a7-ffa4f484edd9 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=6be5d78d2d0049448c3947b4e650758a&device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 1097 time: 0.1049702 Dec 09 14:47:15.273975 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b0866489-ff81-4c56-91fc-50f2337862bd admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:15.282295 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-169b1551-177c-4057-98a1-80fe8f0f0088 req-984d3956-b60c-4b76-96ca-97733b9ce162 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:15.283841 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-169b1551-177c-4057-98a1-80fe8f0f0088 req-984d3956-b60c-4b76-96ca-97733b9ce162 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0571444 Dec 09 14:47:15.330991 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-169b1551-177c-4057-98a1-80fe8f0f0088 req-cacf79fd-97a6-4e06-9efd-86dc25a46260 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409367 Dec 09 14:47:15.353504 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e6f617-029c-4b11-aba7-493f3103bbe7 req-d35a53f2-e311-49db-91ad-d1198748636c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:15.354976 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-18e6f617-029c-4b11-aba7-493f3103bbe7 req-d35a53f2-e311-49db-91ad-d1198748636c service neutron] 10.222.0.44 "GET /v2.0/networks?id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b HTTP/1.1" status: 200 len: 911 time: 0.2012260 Dec 09 14:47:15.464032 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-18e6f617-029c-4b11-aba7-493f3103bbe7 req-5b9c9a0d-cc7f-4234-b96a-11f285b5e7b3 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c5d8b8cc-2c67-46a7-867d-276136fccdf1 HTTP/1.1" status: 200 len: 1000 time: 0.0996244 Dec 09 14:47:15.468139 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ea18ae-26dc-4d70-a0d9-ac2e12b950e4 req-f0c253b1-34e4-49fa-998d-3ddba151e1e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:15.469543 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-90ea18ae-26dc-4d70-a0d9-ac2e12b950e4 req-f0c253b1-34e4-49fa-998d-3ddba151e1e9 service neutron] 10.222.0.44 "GET /v2.0/networks?id=9ab3f8b6-44d0-4210-907d-0e96072c4566 HTTP/1.1" status: 200 len: 917 time: 0.1935203 Dec 09 14:47:15.558421 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b0866489-ff81-4c56-91fc-50f2337862bd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:15.561689 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-90ea18ae-26dc-4d70-a0d9-ac2e12b950e4 req-6d791bdc-8c2c-4ac4-ace3-54b78e12bd97 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d37591e8-0953-4fbc-9688-71f4c813e43c HTTP/1.1" status: 200 len: 217 time: 0.0828836 Dec 09 14:47:15.565687 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b0866489-ff81-4c56-91fc-50f2337862bd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:15.601020 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e6f617-029c-4b11-aba7-493f3103bbe7 req-b79eacff-c61b-4db4-9e40-89abdfefeb23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:15.602471 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-18e6f617-029c-4b11-aba7-493f3103bbe7 req-b79eacff-c61b-4db4-9e40-89abdfefeb23 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=4b7e026c-4454-4200-91c3-30d27a976452 HTTP/1.1" status: 200 len: 849 time: 0.1247618 Dec 09 14:47:15.648532 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0866489-ff81-4c56-91fc-50f2337862bd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4cb70857-090c-40ab-a06d-08ccd28b300b,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:15.672736 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-b0866489-ff81-4c56-91fc-50f2337862bd admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=04131fa7c4ef40089c5137b4d01458b4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4238114 Dec 09 14:47:15.675786 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58804) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:15.683308 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ea18ae-26dc-4d70-a0d9-ac2e12b950e4 req-12e36e28-18d9-4ae3-8fb0-7f4928946de2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:15.684801 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-90ea18ae-26dc-4d70-a0d9-ac2e12b950e4 req-12e36e28-18d9-4ae3-8fb0-7f4928946de2 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=f10f1097-5d43-4737-bcac-a27ade66b442 HTTP/1.1" status: 200 len: 855 time: 0.1116409 Dec 09 14:47:15.705056 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e6f617-029c-4b11-aba7-493f3103bbe7 req-37433b45-c180-4c50-babd-a8210b3b0c0a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:15.710529 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-18e6f617-029c-4b11-aba7-493f3103bbe7 req-37433b45-c180-4c50-babd-a8210b3b0c0a service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0791993 Dec 09 14:47:15.726143 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c0eb0817-d01f-4fda-938b-350dced431a2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:15.750219 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c0eb0817-d01f-4fda-938b-350dced431a2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:15.785315 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ea18ae-26dc-4d70-a0d9-ac2e12b950e4 req-b7fec8f5-c98f-4652-b4fb-ebfa38231628 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:15.786839 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-90ea18ae-26dc-4d70-a0d9-ac2e12b950e4 req-b7fec8f5-c98f-4652-b4fb-ebfa38231628 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=9ab3f8b6-44d0-4210-907d-0e96072c4566&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0937254 Dec 09 14:47:15.812651 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c0eb0817-d01f-4fda-938b-350dced431a2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:15.816758 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c0eb0817-d01f-4fda-938b-350dced431a2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:15.823331 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-c0eb0817-d01f-4fda-938b-350dced431a2 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/4cb70857-090c-40ab-a06d-08ccd28b300b HTTP/1.1" status: 204 len: 168 time: 0.1460631 Dec 09 14:47:15.833824 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0eb0817-d01f-4fda-938b-350dced431a2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4cb70857-090c-40ab-a06d-08ccd28b300b,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:15.863398 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-18e6f617-029c-4b11-aba7-493f3103bbe7 req-8d6f2026-229d-4a88-9c4c-f1f9c067ad0b service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1425366 Dec 09 14:47:15.958003 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-90ea18ae-26dc-4d70-a0d9-ac2e12b950e4 req-41b48658-4c33-42b4-bb07-577f244b723e service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1607299 Dec 09 14:47:16.029682 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-18e6f617-029c-4b11-aba7-493f3103bbe7 req-59ffb5a3-d098-450a-a17d-7cc33c55c91a service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1564848 Dec 09 14:47:16.073283 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-90ea18ae-26dc-4d70-a0d9-ac2e12b950e4 req-1872e03d-1f5e-4920-80e7-a98370198b9f service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1027164 Dec 09 14:47:16.304359 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3860c6fa-facb-4c85-bdf7-29cf904a2286 req-cb4079ad-912e-42ec-bf8f-005fdff98b11 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:16.305839 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3860c6fa-facb-4c85-bdf7-29cf904a2286 req-cb4079ad-912e-42ec-bf8f-005fdff98b11 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0496094 Dec 09 14:47:16.358520 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3860c6fa-facb-4c85-bdf7-29cf904a2286 req-d2c2558d-f155-4a6c-9a3f-9788a0ee43a0 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465221 Dec 09 14:47:16.452647 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0997e86e-dc10-4dfe-958f-59cac935c8c5 req-88f458e6-2fd4-4613-8e89-43a7d9a83977 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:16.454164 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0997e86e-dc10-4dfe-958f-59cac935c8c5 req-88f458e6-2fd4-4613-8e89-43a7d9a83977 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0500782 Dec 09 14:47:16.509584 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0997e86e-dc10-4dfe-958f-59cac935c8c5 req-b7b64e5f-c097-44e9-9788-e7cd90424b08 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489836 Dec 09 14:47:17.479338 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6da36910-90ff-4903-912e-f7fb5bcbfd1f req-f291a213-54ed-4b6d-b9dc-583e905ccdd4 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:17.480900 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6da36910-90ff-4903-912e-f7fb5bcbfd1f req-f291a213-54ed-4b6d-b9dc-583e905ccdd4 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0543227 Dec 09 14:47:17.530386 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6da36910-90ff-4903-912e-f7fb5bcbfd1f req-0c818e29-6c7c-46bb-b5a1-6e1a45aae1c7 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432749 Dec 09 14:47:17.633397 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e63d49-bca7-4a20-a9bc-2a77e5e54e2e req-d098a6a7-aa53-4906-b450-d9ba6c58eace tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:17.634937 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-82e63d49-bca7-4a20-a9bc-2a77e5e54e2e req-d098a6a7-aa53-4906-b450-d9ba6c58eace tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0509453 Dec 09 14:47:17.684768 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-82e63d49-bca7-4a20-a9bc-2a77e5e54e2e req-c492b34a-bbdd-43a6-b4d1-8a91030918f8 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435357 Dec 09 14:47:17.893423 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 58892) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:18.002725 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b1a7cbe2-99b6-4ee6-a366-d6a6da83a155 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.083823 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b1a7cbe2-99b6-4ee6-a366-d6a6da83a155 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.089554 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b1a7cbe2-99b6-4ee6-a366-d6a6da83a155 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.127600 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-b1a7cbe2-99b6-4ee6-a366-d6a6da83a155 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=5efc67227fcd4e329bf4f022fb138566&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2330499 Dec 09 14:47:18.128555 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1a7cbe2-99b6-4ee6-a366-d6a6da83a155 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=89bc492b-668c-4746-ac86-ba901f896313,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:18.131169 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58898) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:18.183196 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-33667f14-924f-4efd-9bbe-725c547ff868 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.203435 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-33667f14-924f-4efd-9bbe-725c547ff868 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.239416 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device d37591e8-0953-4fbc-9688-71f4c813e43c details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:47:18.253434 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-33667f14-924f-4efd-9bbe-725c547ff868 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.256229 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-33667f14-924f-4efd-9bbe-725c547ff868 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.257480 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-33667f14-924f-4efd-9bbe-725c547ff868 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/89bc492b-668c-4746-ac86-ba901f896313 HTTP/1.1" status: 204 len: 168 time: 0.1251814 Dec 09 14:47:18.266007 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33667f14-924f-4efd-9bbe-725c547ff868 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=89bc492b-668c-4746-ac86-ba901f896313,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:18.348146 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port d37591e8-0953-4fbc-9688-71f4c813e43c, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=d37591e8-0953-4fbc-9688-71f4c813e43c,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:47:18.359482 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'port_id': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'mac_address': 'fa:16:3e:86:68:b2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 412, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:47:18.399870 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.539502 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58904) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:18.543813 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d37591e8-0953-4fbc-9688-71f4c813e43c {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:47:18.553253 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c0763588-eb68-48f8-ad4e-c00064e58dde admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.564154 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port d37591e8-0953-4fbc-9688-71f4c813e43c, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=d37591e8-0953-4fbc-9688-71f4c813e43c,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:47:18.568689 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.617692 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=d37591e8-0953-4fbc-9688-71f4c813e43c,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:18.625037 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:18.625399 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:18.625755 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:18.626096 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:18.626394 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:18.626756 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:18.627083 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:18.627399 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:18.627775 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:18.628093 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:18.628391 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:18.628600 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c0763588-eb68-48f8-ad4e-c00064e58dde admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.628721 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:18.629015 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:18.633856 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c0763588-eb68-48f8-ad4e-c00064e58dde admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.671526 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-c0763588-eb68-48f8-ad4e-c00064e58dde admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=aa5e140cd6b14ad984c2f2844ce81ed7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1309216 Dec 09 14:47:18.672305 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0763588-eb68-48f8-ad4e-c00064e58dde admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=932ccf6a-94b6-47c3-ae30-2aa16af1cfcd,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:18.674298 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 58906) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:18.730398 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-21268e67-19e1-4ee3-af3e-cc0ecb29a911 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.752368 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-21268e67-19e1-4ee3-af3e-cc0ecb29a911 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.821849 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1577055-a6f3-49b1-a39f-2594043f0e82 req-efb25f09-4bb1-407d-9111-ca5112c5b919 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:18.823321 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c1577055-a6f3-49b1-a39f-2594043f0e82 req-efb25f09-4bb1-407d-9111-ca5112c5b919 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 945 time: 0.0647142 Dec 09 14:47:18.837997 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-21268e67-19e1-4ee3-af3e-cc0ecb29a911 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.840492 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-21268e67-19e1-4ee3-af3e-cc0ecb29a911 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:18.841531 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-21268e67-19e1-4ee3-af3e-cc0ecb29a911 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/932ccf6a-94b6-47c3-ae30-2aa16af1cfcd HTTP/1.1" status: 204 len: 168 time: 0.1662378 Dec 09 14:47:18.856962 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21268e67-19e1-4ee3-af3e-cc0ecb29a911 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=932ccf6a-94b6-47c3-ae30-2aa16af1cfcd,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:18.890198 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c1577055-a6f3-49b1-a39f-2594043f0e82 req-851f27da-a007-42c9-8c75-4e28dc652398 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0603118 Dec 09 14:47:19.931683 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 58942) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:20.010711 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c9965fa-1d3e-46e3-8499-018f92d15f87 req-7d396202-9b00-44ae-a98c-3affc7ef9152 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:20.012247 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7c9965fa-1d3e-46e3-8499-018f92d15f87 req-7d396202-9b00-44ae-a98c-3affc7ef9152 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 945 time: 0.0514421 Dec 09 14:47:20.044932 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b71f6993-ea23-4d45-a903-99fca7cbec04 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:20.085705 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7c9965fa-1d3e-46e3-8499-018f92d15f87 req-6c4b760a-af4d-4aee-a2a0-c1139a03dee1 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0673614 Dec 09 14:47:20.141115 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b71f6993-ea23-4d45-a903-99fca7cbec04 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:20.146970 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b71f6993-ea23-4d45-a903-99fca7cbec04 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:20.183423 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-b71f6993-ea23-4d45-a903-99fca7cbec04 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=6fd36a587e324e37ae1c81d6f113c679&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2505760 Dec 09 14:47:20.184093 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b71f6993-ea23-4d45-a903-99fca7cbec04 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=08a8c643-35a7-4f30-9974-e2562b9be9c1,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:20.186079 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 58948) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:20.236776 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-11a3bde1-581f-4fa3-a0ca-6a6dcca72345 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:20.262170 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-11a3bde1-581f-4fa3-a0ca-6a6dcca72345 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:20.308160 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-11a3bde1-581f-4fa3-a0ca-6a6dcca72345 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:20.310728 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-11a3bde1-581f-4fa3-a0ca-6a6dcca72345 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:20.311942 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-11a3bde1-581f-4fa3-a0ca-6a6dcca72345 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/08a8c643-35a7-4f30-9974-e2562b9be9c1 HTTP/1.1" status: 204 len: 168 time: 0.1248038 Dec 09 14:47:20.319718 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11a3bde1-581f-4fa3-a0ca-6a6dcca72345 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08a8c643-35a7-4f30-9974-e2562b9be9c1,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:20.550877 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['d37591e8-0953-4fbc-9688-71f4c813e43c'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:47:21.212389 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-919d7322-af29-4962-a16a-2a8f76931984 req-725d3380-d219-41fb-bffc-bab3cc2d11a0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:21.214562 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-919d7322-af29-4962-a16a-2a8f76931984 req-725d3380-d219-41fb-bffc-bab3cc2d11a0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 945 time: 0.0557823 Dec 09 14:47:21.271195 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-919d7322-af29-4962-a16a-2a8f76931984 req-842844c7-d29b-4a70-94c8-d23903b054da tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501633 Dec 09 14:47:22.237491 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device d37591e8-0953-4fbc-9688-71f4c813e43c up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:47:22.300276 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port d37591e8-0953-4fbc-9688-71f4c813e43c completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:47:22.304677 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port d37591e8-0953-4fbc-9688-71f4c813e43c triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:47:22.305010 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:22.395535 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:22.399138 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83727334-24e2-4377-914f-d4d5d4279a88 req-075d2227-a2cf-4f94-92ee-3176a649a368 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:22.401373 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-83727334-24e2-4377-914f-d4d5d4279a88 req-075d2227-a2cf-4f94-92ee-3176a649a368 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 945 time: 0.0568721 Dec 09 14:47:22.424708 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '496052b6-9737-4680-bcd6-64721946b1a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd37591e8-0953-4fbc-9688-71f4c813e43c'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:47:22.427573 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b90350cd-bca1-4ea7-883d-b9b32b1edc22" -d '{"events": [{"server_uuid": "496052b6-9737-4680-bcd6-64721946b1a4", "name": "network-vif-plugged", "status": "completed", "tag": "d37591e8-0953-4fbc-9688-71f4c813e43c"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:47:22.444140 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port d37591e8-0953-4fbc-9688-71f4c813e43c, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=d37591e8-0953-4fbc-9688-71f4c813e43c,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:47:22.450063 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:22.488443 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-83727334-24e2-4377-914f-d4d5d4279a88 req-4266afef-3a0f-4f90-b84e-4154ee44d18c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0807700 Dec 09 14:47:22.491289 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:47:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8ceaca41-4479-47f1-ac30-f4b96364cdd8 x-openstack-request-id: req-8ceaca41-4479-47f1-ac30-f4b96364cdd8 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:47:22.491497 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "496052b6-9737-4680-bcd6-64721946b1a4", "name": "network-vif-plugged", "status": "completed", "tag": "d37591e8-0953-4fbc-9688-71f4c813e43c", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:47:22.491800 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-8ceaca41-4479-47f1-ac30-f4b96364cdd8 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:47:22.492194 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '496052b6-9737-4680-bcd6-64721946b1a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'code': 200} Dec 09 14:47:22.516060 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=d37591e8-0953-4fbc-9688-71f4c813e43c,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:22.689342 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90187f7d-354c-45de-9368-198cc9e265f4 req-4774c4f7-1030-4a25-97ef-14344a2e534e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:22.690808 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-90187f7d-354c-45de-9368-198cc9e265f4 req-4774c4f7-1030-4a25-97ef-14344a2e534e service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 1099 time: 0.0408950 Dec 09 14:47:22.741395 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-90187f7d-354c-45de-9368-198cc9e265f4 req-e5eed8cf-3327-4138-adc0-315abcd2ee6d service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398796 Dec 09 14:47:23.615394 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0776ff16-d96b-47e2-8b8b-cdb98e5715ce req-323d8a61-2429-415b-b3c5-7f2a72a264ee tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:23.616864 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0776ff16-d96b-47e2-8b8b-cdb98e5715ce req-323d8a61-2429-415b-b3c5-7f2a72a264ee tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0524485 Dec 09 14:47:23.666307 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0776ff16-d96b-47e2-8b8b-cdb98e5715ce req-acac02d3-e429-4bb0-aa25-bcf1e99a7169 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427704 Dec 09 14:47:24.792171 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8a4eca2-5f6f-4d10-92d8-85a7464fbce0 req-f569c2d3-35d3-4884-84a2-f424dffa2824 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:24.793601 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b8a4eca2-5f6f-4d10-92d8-85a7464fbce0 req-f569c2d3-35d3-4884-84a2-f424dffa2824 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0535412 Dec 09 14:47:24.839630 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b8a4eca2-5f6f-4d10-92d8-85a7464fbce0 req-a8d9694a-d8ea-4797-9ed3-0dec46a052b0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0398333 Dec 09 14:47:25.976570 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24be1a63-8f87-4281-a44b-c557fd0c7be7 req-f75aa289-4fa7-497f-9539-d62ed3a8f88a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:25.978041 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-24be1a63-8f87-4281-a44b-c557fd0c7be7 req-f75aa289-4fa7-497f-9539-d62ed3a8f88a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0557001 Dec 09 14:47:26.036349 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-24be1a63-8f87-4281-a44b-c557fd0c7be7 req-d583fea1-14f1-4b2d-a330-866aaf5b7608 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515337 Dec 09 14:47:26.998137 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-aeeb185d-08cb-4bb9-8ec8-1e7dd509ebe4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:27.160525 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55d22661-f95c-46e2-9fd8-8a52b37a0515 req-a566a7e7-b72a-489a-b2b2-eeae30aa46a6 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:27.162069 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-55d22661-f95c-46e2-9fd8-8a52b37a0515 req-a566a7e7-b72a-489a-b2b2-eeae30aa46a6 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0496178 Dec 09 14:47:27.209785 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-55d22661-f95c-46e2-9fd8-8a52b37a0515 req-c3dc6ff4-1881-49ae-89e6-62fbaa61c8a8 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415933 Dec 09 14:47:27.337029 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2fb29f0-a637-4f95-8836-9aa3bb96b5d6 req-24424d25-1575-4a03-a053-49642125c587 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:27.338422 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b2fb29f0-a637-4f95-8836-9aa3bb96b5d6 req-24424d25-1575-4a03-a053-49642125c587 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0581245 Dec 09 14:47:27.351908 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 59070) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:27.356197 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-09a96566-20cf-449f-9926-ce49a4f6dfa2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Request body: {'floatingip': {'port_id': 'd37591e8-0953-4fbc-9688-71f4c813e43c'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:47:27.395495 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-09a96566-20cf-449f-9926-ce49a4f6dfa2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for floatingip, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:28.060528 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b5a8fad-938e-4972-a6e4-cc2398cbec7a req-753491e5-bf46-4447-b9ec-a9779028728a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:28.061945 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2b5a8fad-938e-4972-a6e4-cc2398cbec7a req-753491e5-bf46-4447-b9ec-a9779028728a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.3717713 Dec 09 14:47:28.068313 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f86be7b-afa3-489c-a2ef-9631d582d180 req-4bf94b90-5e9b-42b0-ac6a-ff53646f15b5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:28.069679 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9f86be7b-afa3-489c-a2ef-9631d582d180 req-4bf94b90-5e9b-42b0-ac6a-ff53646f15b5 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=ed13d07c829a42dca57ff23f7538ecda&device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 1137 time: 0.3806620 Dec 09 14:47:28.273226 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2b5a8fad-938e-4972-a6e4-cc2398cbec7a req-c9eb5bce-24be-47e3-9bc2-42a7e8cc7399 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.2025366 Dec 09 14:47:28.284070 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-09a96566-20cf-449f-9926-ce49a4f6dfa2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:28.289301 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f86be7b-afa3-489c-a2ef-9631d582d180 req-32cd7d28-7808-4b9d-b36d-445c4791d809 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:28.290839 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9f86be7b-afa3-489c-a2ef-9631d582d180 req-32cd7d28-7808-4b9d-b36d-445c4791d809 service neutron] 10.222.0.44 "GET /v2.0/networks?id=ec211a40-6211-48b6-8014-deb1231b8f8a HTTP/1.1" status: 200 len: 916 time: 0.2088628 Dec 09 14:47:28.291934 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-09a96566-20cf-449f-9926-ce49a4f6dfa2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:28.427509 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9f86be7b-afa3-489c-a2ef-9631d582d180 req-7f604771-2124-4fb2-8382-4d116c67b85c service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=0033cc00-709a-496e-9a3b-1837dafd79dd HTTP/1.1" status: 200 len: 1001 time: 0.0986528 Dec 09 14:47:28.470292 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.l3_db [None req-09a96566-20cf-449f-9926-ce49a4f6dfa2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Floating IP 6a652206-bd32-429c-9f48-2defb12c69f0 associated. External IP: 172.27.0.254, port: d37591e8-0953-4fbc-9688-71f4c813e43c. Dec 09 14:47:28.518522 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f86be7b-afa3-489c-a2ef-9631d582d180 req-b6e5b5e6-a780-4fc9-b7af-2c83050ea679 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:28.519999 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9f86be7b-afa3-489c-a2ef-9631d582d180 req-b6e5b5e6-a780-4fc9-b7af-2c83050ea679 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=3e261ed3-068f-4b13-8a79-5f90048fcbe6 HTTP/1.1" status: 200 len: 854 time: 0.0841489 Dec 09 14:47:28.616594 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f86be7b-afa3-489c-a2ef-9631d582d180 req-68833236-f934-49f2-84c6-50b185b263b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:28.618145 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9f86be7b-afa3-489c-a2ef-9631d582d180 req-68833236-f934-49f2-84c6-50b185b263b1 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=ec211a40-6211-48b6-8014-deb1231b8f8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0882428 Dec 09 14:47:28.785525 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9f86be7b-afa3-489c-a2ef-9631d582d180 req-0c29daf4-5cf2-4449-b563-46735fcee410 service neutron] 10.222.0.44 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1380825 Dec 09 14:47:28.789339 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-09a96566-20cf-449f-9926-ce49a4f6dfa2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:47:28.958728 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-09a96566-20cf-449f-9926-ce49a4f6dfa2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:47:28.961830 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9f86be7b-afa3-489c-a2ef-9631d582d180 req-b8bf32a2-8854-4f1a-87a8-eecd10fe83f9 service neutron] 10.222.0.44 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1604416 Dec 09 14:47:28.964848 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-09a96566-20cf-449f-9926-ce49a4f6dfa2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:28.969470 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-969bb72b-06ce-4d3d-805e-3274d146b0ed None None] Sync routers for ids ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:47:28.979915 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-969bb72b-06ce-4d3d-805e-3274d146b0ed None None] Routers {'49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:47:28.980668 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-969bb72b-06ce-4d3d-805e-3274d146b0ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:46:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:47:28.993941 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-09a96566-20cf-449f-9926-ce49a4f6dfa2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "PUT /v2.0/floatingips/6a652206-bd32-429c-9f48-2defb12c69f0 HTTP/1.1" status: 200 len: 992 time: 1.6409786 Dec 09 14:47:28.994851 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '496052b6-9737-4680-bcd6-64721946b1a4', 'tag': 'd37591e8-0953-4fbc-9688-71f4c813e43c'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:47:28.997178 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-75d1a41e-fd77-4483-8245-792fb7cd5ecc" -d '{"events": [{"name": "network-changed", "server_uuid": "496052b6-9737-4680-bcd6-64721946b1a4", "tag": "d37591e8-0953-4fbc-9688-71f4c813e43c"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:47:29.047128 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:47:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7661e393-ca61-4789-831f-0cd603fdbc72 x-openstack-request-id: req-7661e393-ca61-4789-831f-0cd603fdbc72 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:47:29.047454 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "496052b6-9737-4680-bcd6-64721946b1a4", "tag": "d37591e8-0953-4fbc-9688-71f4c813e43c", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:47:29.047958 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-7661e393-ca61-4789-831f-0cd603fdbc72 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:47:29.048394 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '496052b6-9737-4680-bcd6-64721946b1a4', 'tag': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'status': 'completed', 'code': 200} Dec 09 14:47:29.090909 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-969bb72b-06ce-4d3d-805e-3274d146b0ed None None] Set router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:47:29.143439 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75d1a41e-fd77-4483-8245-792fb7cd5ecc req-276dc77c-4c56-4bbe-8349-8cf539ad1209 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:29.145569 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-75d1a41e-fd77-4483-8245-792fb7cd5ecc req-276dc77c-4c56-4bbe-8349-8cf539ad1209 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=6be5d78d2d0049448c3947b4e650758a&device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 1099 time: 0.0518146 Dec 09 14:47:29.207528 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f55c606e-3e6e-4ae9-920e-34f07a1a5b42 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:29.257656 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75d1a41e-fd77-4483-8245-792fb7cd5ecc req-6829516d-0382-47b6-93a9-158312bc9f2a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:29.259191 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-75d1a41e-fd77-4483-8245-792fb7cd5ecc req-6829516d-0382-47b6-93a9-158312bc9f2a service neutron] 10.222.0.44 "GET /v2.0/networks?id=9ab3f8b6-44d0-4210-907d-0e96072c4566 HTTP/1.1" status: 200 len: 917 time: 0.0954862 Dec 09 14:47:29.328200 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-75d1a41e-fd77-4483-8245-792fb7cd5ecc req-1e0bf6d7-ab16-42f5-8970-d57b6fd2fe95 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d37591e8-0953-4fbc-9688-71f4c813e43c HTTP/1.1" status: 200 len: 1000 time: 0.0606081 Dec 09 14:47:29.340358 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-969bb72b-06ce-4d3d-805e-3274d146b0ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '6a652206-bd32-429c-9f48-2defb12c69f0', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'floating_ip_address': '172.27.0.254', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'port_id': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 491, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'mac_address': 'fa:16:3e:86:68:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '496052b6-9737-4680-bcd6-64721946b1a4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:47:08Z', 'updated_at': '2021-12-09T14:47:28Z', 'revision_number': 1, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6db4124e-4bda-4bda-b604-9b9706732691', 'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'mac_address': 'fa:16:3e:7f:fb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 5, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'subnets': [{'id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:47:29.370684 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-969bb72b-06ce-4d3d-805e-3274d146b0ed None None] Checking router: 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:47:29.380372 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-969bb72b-06ce-4d3d-805e-3274d146b0ed None None] Routers {'49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:47:29.380982 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-969bb72b-06ce-4d3d-805e-3274d146b0ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:47:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:47:29.407100 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75d1a41e-fd77-4483-8245-792fb7cd5ecc req-251b82e1-af68-4c76-a9ee-f66e53b094e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:29.408744 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-75d1a41e-fd77-4483-8245-792fb7cd5ecc req-251b82e1-af68-4c76-a9ee-f66e53b094e8 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=f10f1097-5d43-4737-bcac-a27ade66b442 HTTP/1.1" status: 200 len: 855 time: 0.0728447 Dec 09 14:47:29.433591 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-642f88c5-cd4a-44f3-952c-ee0dba35c3ce req-2ca63562-3c6e-4aa2-a0ee-74f8f568a664 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:29.436352 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-642f88c5-cd4a-44f3-952c-ee0dba35c3ce req-2ca63562-3c6e-4aa2-a0ee-74f8f568a664 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0917609 Dec 09 14:47:29.493326 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-969bb72b-06ce-4d3d-805e-3274d146b0ed None None] Set router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:47:29.507947 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75d1a41e-fd77-4483-8245-792fb7cd5ecc req-fe991f97-8524-472d-a172-7fd4c47e0587 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:29.509394 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-75d1a41e-fd77-4483-8245-792fb7cd5ecc req-fe991f97-8524-472d-a172-7fd4c47e0587 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=9ab3f8b6-44d0-4210-907d-0e96072c4566&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0928211 Dec 09 14:47:29.520141 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-642f88c5-cd4a-44f3-952c-ee0dba35c3ce req-ac20edb0-cc72-4c02-9a53-899274f9efa4 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0668354 Dec 09 14:47:29.616194 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-75d1a41e-fd77-4483-8245-792fb7cd5ecc req-dbf562ef-c07c-4bef-9025-18d45644d8dd service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0949571 Dec 09 14:47:29.709749 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 59110) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:29.726897 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-75d1a41e-fd77-4483-8245-792fb7cd5ecc req-8b9697c9-b887-4093-bd25-8c5ff8239089 service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0991437 Dec 09 14:47:29.737905 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-969bb72b-06ce-4d3d-805e-3274d146b0ed None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '6a652206-bd32-429c-9f48-2defb12c69f0', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'floating_ip_address': '172.27.0.254', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'port_id': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 491, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'mac_address': 'fa:16:3e:86:68:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '496052b6-9737-4680-bcd6-64721946b1a4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:47:08Z', 'updated_at': '2021-12-09T14:47:28Z', 'revision_number': 1, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6db4124e-4bda-4bda-b604-9b9706732691', 'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'mac_address': 'fa:16:3e:7f:fb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 5, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'subnets': [{'id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:47:29.764008 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-969bb72b-06ce-4d3d-805e-3274d146b0ed None None] The sync data for ids ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'] in dv-cinder-819692-8-iscsi is: [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '6a652206-bd32-429c-9f48-2defb12c69f0', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'floating_ip_address': '172.27.0.254', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'port_id': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 491, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'mac_address': 'fa:16:3e:86:68:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '496052b6-9737-4680-bcd6-64721946b1a4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:47:08Z', 'updated_at': '2021-12-09T14:47:28Z', 'revision_number': 1, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '6db4124e-4bda-4bda-b604-9b9706732691', 'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'mac_address': 'fa:16:3e:7f:fb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 5, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'subnets': [{'id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:47:29.826764 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-113ac84a-412e-49f4-9322-3200fa240d24 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:29.906816 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-113ac84a-412e-49f4-9322-3200fa240d24 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:29.912180 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-113ac84a-412e-49f4-9322-3200fa240d24 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:29.951497 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-113ac84a-412e-49f4-9322-3200fa240d24 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=0c4f288ac64c43e0b4239fed2ae9d5c9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2406566 Dec 09 14:47:29.952371 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-113ac84a-412e-49f4-9322-3200fa240d24 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=90aeb3bb-f3b0-47c0-80fe-8c058acfbf25,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:29.954284 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 59114) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:29.979066 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-951d6197-e3d4-493e-8e1f-e02081a1c604 None None] New status for floating IP 6a652206-bd32-429c-9f48-2defb12c69f0: ACTIVE {{(pid=109064) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:47:30.005029 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:30.028722 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:30.074810 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:30.077841 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:30.079192 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/90aeb3bb-f3b0-47c0-80fe-8c058acfbf25 HTTP/1.1" status: 204 len: 168 time: 0.1233215 Dec 09 14:47:30.088252 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=90aeb3bb-f3b0-47c0-80fe-8c058acfbf25,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:30.097683 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:30.098269 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:30.098714 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:30.099712 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:30.099821 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:30.100250 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:30.100743 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:30.101168 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:30.101588 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:30.102152 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:30.102685 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:30.103111 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:30.103528 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f13d113e-5a45-4d72-a8d4-4250761f89fb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:47:30.431477 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:30.641500 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6106bd1f-2338-40a6-aeb4-204402412f59 req-79967e1c-0462-45db-a91c-97002873fc21 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:30.643083 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6106bd1f-2338-40a6-aeb4-204402412f59 req-79967e1c-0462-45db-a91c-97002873fc21 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0526843 Dec 09 14:47:30.707243 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6106bd1f-2338-40a6-aeb4-204402412f59 req-0e04f0d2-54ae-4cb5-9f1c-cff87a823ab0 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0579584 Dec 09 14:47:31.803169 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:31.826190 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce68c482-70f7-4f3d-92c9-7931615236f1 req-f17d7c50-a94c-482b-8c8a-ba6fc95e859d tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:31.827689 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ce68c482-70f7-4f3d-92c9-7931615236f1 req-f17d7c50-a94c-482b-8c8a-ba6fc95e859d tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0517294 Dec 09 14:47:31.893254 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ce68c482-70f7-4f3d-92c9-7931615236f1 req-e716f730-598b-459d-969a-9b4fd5ef9a38 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0592005 Dec 09 14:47:32.609249 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:33.021980 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90ef3f93-353f-483b-b37f-b38f05c6f106 req-60b22b93-9992-4924-8188-8e1ec22bb6ea tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:33.026065 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-90ef3f93-353f-483b-b37f-b38f05c6f106 req-60b22b93-9992-4924-8188-8e1ec22bb6ea tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0559542 Dec 09 14:47:33.089914 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-90ef3f93-353f-483b-b37f-b38f05c6f106 req-b89bc3e5-9637-4568-b492-eae925cfe000 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0598907 Dec 09 14:47:33.304050 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56f42bb6-a7de-48bf-bd00-f5fe2dd5facd req-39091ff0-2c81-418a-b09e-8f751b6e7605 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:33.305494 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-56f42bb6-a7de-48bf-bd00-f5fe2dd5facd req-39091ff0-2c81-418a-b09e-8f751b6e7605 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.2325263 Dec 09 14:47:33.365488 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-56f42bb6-a7de-48bf-bd00-f5fe2dd5facd req-6b37c192-2556-40be-a583-2365bcb9b95e tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430064 Dec 09 14:47:34.215078 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caab0394-2d58-41c1-8383-e30eb2832d23 req-8d6e3adf-1653-404e-8e5f-f9033d623511 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:34.216600 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-caab0394-2d58-41c1-8383-e30eb2832d23 req-8d6e3adf-1653-404e-8e5f-f9033d623511 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0546918 Dec 09 14:47:34.277074 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-caab0394-2d58-41c1-8383-e30eb2832d23 req-982dd604-5de2-495b-be8f-3bc62ee8c2d7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0542860 Dec 09 14:47:34.491114 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dcb2b4a-5843-43ad-9c7b-ed7466144559 req-1e69a172-e582-44d0-b3f7-f0d54db9c109 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:34.492623 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0dcb2b4a-5843-43ad-9c7b-ed7466144559 req-1e69a172-e582-44d0-b3f7-f0d54db9c109 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0616181 Dec 09 14:47:34.544806 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0dcb2b4a-5843-43ad-9c7b-ed7466144559 req-9677280d-38d4-4eab-9577-7b0cc866d77a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427487 Dec 09 14:47:35.393420 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-722f17df-20b8-420c-9583-3ea431a5946e req-abc082bb-457f-4778-a3ea-0a2841b93fb2 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:35.394869 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-722f17df-20b8-420c-9583-3ea431a5946e req-abc082bb-457f-4778-a3ea-0a2841b93fb2 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0506685 Dec 09 14:47:35.454320 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-722f17df-20b8-420c-9583-3ea431a5946e req-b00ae70d-d646-4c62-81f9-86acc960112a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0533969 Dec 09 14:47:35.677095 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d4d9ff0-3686-463d-94e1-51ad7601235f req-bf039e00-117b-4f24-bbe5-0c7677f7748c tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:35.678570 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2d4d9ff0-3686-463d-94e1-51ad7601235f req-bf039e00-117b-4f24-bbe5-0c7677f7748c tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0545638 Dec 09 14:47:35.728204 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2d4d9ff0-3686-463d-94e1-51ad7601235f req-87862c80-e87f-41ff-bed9-f0e6d71070e5 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435708 Dec 09 14:47:36.639547 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0202531-c31e-42e2-93b3-20a87315db5b req-a42c46d0-91ab-4750-b55b-a40145416a61 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:36.641076 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d0202531-c31e-42e2-93b3-20a87315db5b req-a42c46d0-91ab-4750-b55b-a40145416a61 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.1163764 Dec 09 14:47:36.702755 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d0202531-c31e-42e2-93b3-20a87315db5b req-f912a6a4-c055-4db9-a5f6-d51ded37a5d3 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0553944 Dec 09 14:47:36.849184 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21abd811-d81c-4fbb-ac72-fbf8397a3684 req-d79cf016-f9e0-43c7-82e9-d41b5e7b82bc tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:36.850827 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-21abd811-d81c-4fbb-ac72-fbf8397a3684 req-d79cf016-f9e0-43c7-82e9-d41b5e7b82bc tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0524757 Dec 09 14:47:36.858013 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 59238) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:36.906236 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-21abd811-d81c-4fbb-ac72-fbf8397a3684 req-281d86b5-880d-47bb-bb2d-97ac16b35c2b tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0488238 Dec 09 14:47:36.906521 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_v2 [None req-baefab82-1eb3-459b-9426-c77d055637f5 admin admin] Deleting subnet a44bb60f-825d-4a27-a5af-fbe9e6e78fb7 {{(pid=109062) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:47:36.909659 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-baefab82-1eb3-459b-9426-c77d055637f5 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:36.944068 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-baefab82-1eb3-459b-9426-c77d055637f5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-130415749'] for subnet, precommit_delete_associations {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:36.981553 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-baefab82-1eb3-459b-9426-c77d055637f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:37.036328 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-baefab82-1eb3-459b-9426-c77d055637f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-130461228', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-130768914'] for subnet, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:37.064510 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baefab82-1eb3-459b-9426-c77d055637f5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a44bb60f-825d-4a27-a5af-fbe9e6e78fb7,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:37.068255 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-baefab82-1eb3-459b-9426-c77d055637f5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:37.071438 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-baefab82-1eb3-459b-9426-c77d055637f5 admin admin] 10.222.0.39 "DELETE /v2.0/subnets/a44bb60f-825d-4a27-a5af-fbe9e6e78fb7 HTTP/1.1" status: 204 len: 168 time: 0.2123909 Dec 09 14:47:37.074605 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 59240) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:37.140268 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2868e754-b4bf-400f-927a-d1cb8d1788c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:37.221085 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2868e754-b4bf-400f-927a-d1cb8d1788c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:37.240534 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-2868e754-b4bf-400f-927a-d1cb8d1788c0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8ae9a24a-645d-43a9-b32c-41629b26c09e']}} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:47:37.249977 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-2868e754-b4bf-400f-927a-d1cb8d1788c0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e2f74911-9ec7-4d46-b689-ab5ae0cbb567') {'for_net_delete': True} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:47:37.250268 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-2868e754-b4bf-400f-927a-d1cb8d1788c0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e2f74911-9ec7-4d46-b689-ab5ae0cbb567') {} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:47:37.263190 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2868e754-b4bf-400f-927a-d1cb8d1788c0 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-130415758'] for segment, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:37.276636 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2868e754-b4bf-400f-927a-d1cb8d1788c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:37.282600 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2868e754-b4bf-400f-927a-d1cb8d1788c0 admin admin] Releasing vlan 421 on physical network physnet1 to pool {{(pid=109062) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:47:37.282979 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2868e754-b4bf-400f-927a-d1cb8d1788c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-130461398'] for segment, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: Traceback (most recent call last): Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: timer() Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: cb(*args, **kw) Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: return func(*args, **kwargs) Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: self._notify() Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: self.callback(batched_events) Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: event.method(event) Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: return f(self, *a, **k) Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._get(url).json() Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: return self.request(url, 'GET', **kwargs) Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:47:37.284635 dv-cinder-819692-8-iscsi neutron-server[109062]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:47:37.338843 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2868e754-b4bf-400f-927a-d1cb8d1788c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:37.344122 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2868e754-b4bf-400f-927a-d1cb8d1788c0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:37.347213 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-2868e754-b4bf-400f-927a-d1cb8d1788c0 admin admin] 10.222.0.39 "DELETE /v2.0/networks/8ae9a24a-645d-43a9-b32c-41629b26c09e HTTP/1.1" status: 204 len: 168 time: 0.2717245 Dec 09 14:47:37.358241 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2868e754-b4bf-400f-927a-d1cb8d1788c0 admin admin] Pushing event deleted for resources: {'Network': ['ID=8ae9a24a-645d-43a9-b32c-41629b26c09e,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:37.526240 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 59246) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:37.567074 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-f84d35aa-c64d-4f77-8394-1f964a8dd511 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=3b3199edde77497bbdb703336ce72b78&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0396006 Dec 09 14:47:37.569778 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 59248) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:47:37.628797 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ba7dd1f7-6e98-4b00-88df-f6ef5becb0b6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:37.655399 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ba7dd1f7-6e98-4b00-88df-f6ef5becb0b6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:37.705129 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ba7dd1f7-6e98-4b00-88df-f6ef5becb0b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:37.708215 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ba7dd1f7-6e98-4b00-88df-f6ef5becb0b6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:37.709372 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-ba7dd1f7-6e98-4b00-88df-f6ef5becb0b6 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/c07b8fd5-6306-4357-a7fe-deb9f81df7ba HTTP/1.1" status: 204 len: 168 time: 0.1385834 Dec 09 14:47:37.717761 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba7dd1f7-6e98-4b00-88df-f6ef5becb0b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c07b8fd5-6306-4357-a7fe-deb9f81df7ba,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:47:37.826353 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37935f96-92cc-468d-a407-210f7b6cfb10 req-c40cf60a-276c-438e-b2a5-6217f02f1677 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:37.827859 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-37935f96-92cc-468d-a407-210f7b6cfb10 req-c40cf60a-276c-438e-b2a5-6217f02f1677 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0534873 Dec 09 14:47:37.890219 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-37935f96-92cc-468d-a407-210f7b6cfb10 req-e9160a56-d9d0-4f7a-b4c2-9a741d5d76af tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0560911 Dec 09 14:47:38.021281 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90e4ca9-b6d2-427b-b983-ffa0b96437bd req-1b98dfb3-2889-4a12-ad5a-d907821c94e3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:38.022788 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d90e4ca9-b6d2-427b-b983-ffa0b96437bd req-1b98dfb3-2889-4a12-ad5a-d907821c94e3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0509431 Dec 09 14:47:38.073447 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d90e4ca9-b6d2-427b-b983-ffa0b96437bd req-e6169bda-af43-42be-b670-9e938ab67df7 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444684 Dec 09 14:47:39.024233 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c74379f-ca40-4b4f-a2a7-a3f443737cb4 req-1f3a2cfc-6795-4877-a863-884681898f43 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:39.025682 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3c74379f-ca40-4b4f-a2a7-a3f443737cb4 req-1f3a2cfc-6795-4877-a863-884681898f43 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0522788 Dec 09 14:47:39.092516 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3c74379f-ca40-4b4f-a2a7-a3f443737cb4 req-1f86bb2a-3473-4f93-9757-96acccc41f2a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0577736 Dec 09 14:47:39.205095 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7abd5907-1bd9-40cc-bfc1-ffb337816fb9 req-2252610a-e0ce-43cd-aad8-a8e509d62e8a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:39.206491 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7abd5907-1bd9-40cc-bfc1-ffb337816fb9 req-2252610a-e0ce-43cd-aad8-a8e509d62e8a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0565398 Dec 09 14:47:39.256733 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7abd5907-1bd9-40cc-bfc1-ffb337816fb9 req-7d0cea2e-6fde-4cfd-8425-baf7a8a6115f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440867 Dec 09 14:47:40.232861 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4985c77-9e6a-4066-bf11-ad200fab855e req-449f1311-2238-4c41-863f-8caddf074a58 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:40.234519 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f4985c77-9e6a-4066-bf11-ad200fab855e req-449f1311-2238-4c41-863f-8caddf074a58 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0583665 Dec 09 14:47:40.300457 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f4985c77-9e6a-4066-bf11-ad200fab855e req-b0ef81bd-8ba9-46d2-9d62-c388e35d0dbe tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0596452 Dec 09 14:47:40.379709 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bce4cb8a-0bb7-4143-b35d-242e9c15bb3e req-d622c2a5-85ad-44d0-bae7-9c801f4782be tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:40.381109 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-bce4cb8a-0bb7-4143-b35d-242e9c15bb3e req-d622c2a5-85ad-44d0-bae7-9c801f4782be tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0547717 Dec 09 14:47:40.431086 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-bce4cb8a-0bb7-4143-b35d-242e9c15bb3e req-6e8888a4-3735-49c4-b606-f839dba86918 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439284 Dec 09 14:47:41.436836 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14b11ef8-075f-4bc2-83c6-792ce5b816e8 req-4b5d1a9c-0bb1-4ace-958e-aaa6b9f3e3b9 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:41.438287 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-14b11ef8-075f-4bc2-83c6-792ce5b816e8 req-4b5d1a9c-0bb1-4ace-958e-aaa6b9f3e3b9 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0558777 Dec 09 14:47:41.507142 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-14b11ef8-075f-4bc2-83c6-792ce5b816e8 req-e34587fa-01c6-4992-bc24-018ab98b00b0 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0591629 Dec 09 14:47:41.553116 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-065832db-39b1-4f22-afdc-9db03d6adee5 req-944a6611-b882-4353-84d8-8dc0f57f9253 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:41.554601 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-065832db-39b1-4f22-afdc-9db03d6adee5 req-944a6611-b882-4353-84d8-8dc0f57f9253 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0534582 Dec 09 14:47:41.603626 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-065832db-39b1-4f22-afdc-9db03d6adee5 req-87a4e89e-ad17-4dbb-94de-93464c164d60 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0427570 Dec 09 14:47:42.636531 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10173edb-ae0f-48fb-8b10-f76ba07ee380 req-299dfebb-77e3-44bb-99b6-cd309929c66f tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:42.638065 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-10173edb-ae0f-48fb-8b10-f76ba07ee380 req-299dfebb-77e3-44bb-99b6-cd309929c66f tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0527873 Dec 09 14:47:42.701034 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-10173edb-ae0f-48fb-8b10-f76ba07ee380 req-32d3d83e-0a16-491e-86be-30a3b904a126 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0567257 Dec 09 14:47:42.808455 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37c75cc1-147c-4de0-adaa-4fd711193939 req-67d7086d-9f2e-4d7e-afd1-db377152845f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:42.809821 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-37c75cc1-147c-4de0-adaa-4fd711193939 req-67d7086d-9f2e-4d7e-afd1-db377152845f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0493803 Dec 09 14:47:42.861449 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-37c75cc1-147c-4de0-adaa-4fd711193939 req-93431de2-3945-421b-8973-a39c0f2f72b5 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0457435 Dec 09 14:47:43.824247 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60b68c07-e9b2-44f1-9ddd-a59f73297d73 req-1438dd73-ed1e-422b-844e-08ed2aa8eeb0 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:43.825749 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-60b68c07-e9b2-44f1-9ddd-a59f73297d73 req-1438dd73-ed1e-422b-844e-08ed2aa8eeb0 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0524321 Dec 09 14:47:43.894571 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-60b68c07-e9b2-44f1-9ddd-a59f73297d73 req-eabac6b4-9887-4cd0-8bf9-214ab633b76f tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0625579 Dec 09 14:47:44.005565 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7ffaa15-80a6-4eba-b203-c647559858d1 req-ca9f81b2-9999-430b-a4d7-7c432093f491 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:44.007063 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a7ffaa15-80a6-4eba-b203-c647559858d1 req-ca9f81b2-9999-430b-a4d7-7c432093f491 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0530047 Dec 09 14:47:44.058875 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a7ffaa15-80a6-4eba-b203-c647559858d1 req-cda06cd3-8dc2-403c-8999-ed6071e94256 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445426 Dec 09 14:47:44.822721 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:45.021743 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42ce01a2-4d5c-4d8e-8f79-db293c6ee59c req-7243a0b2-b066-4586-9d2d-cf4c29ae6e0e tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:45.022704 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-42ce01a2-4d5c-4d8e-8f79-db293c6ee59c req-7243a0b2-b066-4586-9d2d-cf4c29ae6e0e tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0541418 Dec 09 14:47:45.086474 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-42ce01a2-4d5c-4d8e-8f79-db293c6ee59c req-c2ef85e3-6d0a-41c8-b6a8-d0388c03f752 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0562212 Dec 09 14:47:45.191015 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2fbe6da-90ab-45d2-8142-a29666940e77 req-d9cb8690-ebd5-4591-aed6-5f4d2b318839 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:45.192524 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c2fbe6da-90ab-45d2-8142-a29666940e77 req-d9cb8690-ebd5-4591-aed6-5f4d2b318839 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0543666 Dec 09 14:47:45.248264 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c2fbe6da-90ab-45d2-8142-a29666940e77 req-2f5b328b-d306-44bd-85cf-2855ca11910b tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0495555 Dec 09 14:47:45.438429 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:47:46.216328 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb032c9d-5922-496e-89b9-4e1d0faa1fe3 req-a5cbe558-91f8-41d0-afe7-3bbf9e7a3eea tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:46.217786 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-bb032c9d-5922-496e-89b9-4e1d0faa1fe3 req-a5cbe558-91f8-41d0-afe7-3bbf9e7a3eea tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0522723 Dec 09 14:47:46.276787 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-bb032c9d-5922-496e-89b9-4e1d0faa1fe3 req-535ec070-68fe-4d72-83d5-189cac29a634 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0521894 Dec 09 14:47:46.390396 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a5114f4-92dd-448d-a042-d33d13788d37 req-28ba8ff5-1c69-4015-b578-99ffff0821c3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:46.391861 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6a5114f4-92dd-448d-a042-d33d13788d37 req-28ba8ff5-1c69-4015-b578-99ffff0821c3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0531282 Dec 09 14:47:46.440143 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6a5114f4-92dd-448d-a042-d33d13788d37 req-e8aac4be-a339-4328-8fc4-817a357a37ed tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424159 Dec 09 14:47:47.412439 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d03621d-47f9-420b-9c0d-f117f37a3daa req-861b4c81-0e73-4535-a1bd-84465519c722 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:47.413926 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3d03621d-47f9-420b-9c0d-f117f37a3daa req-861b4c81-0e73-4535-a1bd-84465519c722 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0603194 Dec 09 14:47:47.482774 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3d03621d-47f9-420b-9c0d-f117f37a3daa req-032f2c9b-dcee-4621-b003-37a96baa9298 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0597651 Dec 09 14:47:47.589464 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cf5f864-9eca-4fe8-9495-09e907019579 req-2ccbd2fd-f95e-4779-9f95-c18f58da19b3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:47.590813 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5cf5f864-9eca-4fe8-9495-09e907019579 req-2ccbd2fd-f95e-4779-9f95-c18f58da19b3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0527954 Dec 09 14:47:47.644803 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5cf5f864-9eca-4fe8-9495-09e907019579 req-2c122426-ef58-4911-82cd-09913d4caaa7 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0471518 Dec 09 14:47:48.599983 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d102ba-5c43-4436-b02a-f4353574be5f req-97d3aac9-75a3-42b0-bfa5-5617f0c03e32 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:48.601519 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f2d102ba-5c43-4436-b02a-f4353574be5f req-97d3aac9-75a3-42b0-bfa5-5617f0c03e32 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0499372 Dec 09 14:47:48.653827 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-baa4f3b0-7f04-4282-87ce-d032163e9f4f req-dc3c4efd-3235-45ac-a5c0-bce8931b1385 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1364059 Dec 09 14:47:48.668295 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f2d102ba-5c43-4436-b02a-f4353574be5f req-da6c2778-dd6f-4896-a6bd-f4dca096d81d tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0586393 Dec 09 14:47:48.781554 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baa4f3b0-7f04-4282-87ce-d032163e9f4f req-34beb6f4-c3bc-41c6-bc6b-d45b08410e95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:48.782970 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-baa4f3b0-7f04-4282-87ce-d032163e9f4f req-34beb6f4-c3bc-41c6-bc6b-d45b08410e95 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=a538bf01cb5440ffa06b6873f212efaa&device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 1098 time: 0.0786803 Dec 09 14:47:48.799068 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f67cb22d-9022-4e3e-9a70-f9ebd8326513 req-ef7465c7-3eac-4724-875e-e5ae8a94c673 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:48.800561 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f67cb22d-9022-4e3e-9a70-f9ebd8326513 req-ef7465c7-3eac-4724-875e-e5ae8a94c673 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0701890 Dec 09 14:47:48.910652 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f67cb22d-9022-4e3e-9a70-f9ebd8326513 req-123dad77-775e-404a-a09b-a58db27433e3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1037536 Dec 09 14:47:48.938887 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baa4f3b0-7f04-4282-87ce-d032163e9f4f req-429b4a7a-e251-4352-96ef-4bbf715073ea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:48.940509 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-baa4f3b0-7f04-4282-87ce-d032163e9f4f req-429b4a7a-e251-4352-96ef-4bbf715073ea service neutron] 10.222.0.44 "GET /v2.0/networks?id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b HTTP/1.1" status: 200 len: 911 time: 0.1265187 Dec 09 14:47:49.020456 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-baa4f3b0-7f04-4282-87ce-d032163e9f4f req-b70485a3-8fa8-4577-9a53-33d0e425ce8e service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=c5d8b8cc-2c67-46a7-867d-276136fccdf1 HTTP/1.1" status: 200 len: 1000 time: 0.0692110 Dec 09 14:47:49.085065 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baa4f3b0-7f04-4282-87ce-d032163e9f4f req-2fab0c20-e2bc-47a4-b5a6-c02d10f6fab7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:49.086539 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-baa4f3b0-7f04-4282-87ce-d032163e9f4f req-2fab0c20-e2bc-47a4-b5a6-c02d10f6fab7 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=4b7e026c-4454-4200-91c3-30d27a976452 HTTP/1.1" status: 200 len: 849 time: 0.0544963 Dec 09 14:47:49.138511 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baa4f3b0-7f04-4282-87ce-d032163e9f4f req-f4279686-83b8-4471-a3e8-8bcdcd49896d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:49.140964 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-baa4f3b0-7f04-4282-87ce-d032163e9f4f req-f4279686-83b8-4471-a3e8-8bcdcd49896d service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0458715 Dec 09 14:47:49.240915 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-baa4f3b0-7f04-4282-87ce-d032163e9f4f req-64573cbc-31d5-4ee3-9237-7b293398c999 service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0916824 Dec 09 14:47:49.340418 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-baa4f3b0-7f04-4282-87ce-d032163e9f4f req-633a9118-50de-40d4-9094-bf81b16813bf service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0893455 Dec 09 14:47:49.791909 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8feff4a-8d1c-4bf1-9d3f-f246f2f6c48d req-0dfd2b6f-0266-491a-a70f-7abaa6665fb0 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:49.793364 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c8feff4a-8d1c-4bf1-9d3f-f246f2f6c48d req-0dfd2b6f-0266-491a-a70f-7abaa6665fb0 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0549271 Dec 09 14:47:49.856082 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c8feff4a-8d1c-4bf1-9d3f-f246f2f6c48d req-82bea125-187f-461b-977b-f797993df0e6 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0560799 Dec 09 14:47:50.039147 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a45c7a3c-7187-4a9a-afcd-5cb55079fcf2 req-680904c0-74b3-41aa-a68d-f42568521f08 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:50.040643 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a45c7a3c-7187-4a9a-afcd-5cb55079fcf2 req-680904c0-74b3-41aa-a68d-f42568521f08 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0540237 Dec 09 14:47:50.094769 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a45c7a3c-7187-4a9a-afcd-5cb55079fcf2 req-3ea83ead-51ba-44ee-a08b-bc63c4c8f527 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455391 Dec 09 14:47:51.001068 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6136492-97dd-4602-b9bd-696fba26b73a req-a6cb1f11-c240-45d1-974d-782562b916e8 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:51.002430 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e6136492-97dd-4602-b9bd-696fba26b73a req-a6cb1f11-c240-45d1-974d-782562b916e8 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0644996 Dec 09 14:47:51.064004 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e6136492-97dd-4602-b9bd-696fba26b73a req-98c2def1-4338-4e21-8490-9d559a2b5f95 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0551279 Dec 09 14:47:51.220739 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5424d232-e950-48f6-b729-30d0f1201c35 req-ed6ef161-86f2-4731-981e-bc99b4a56362 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:51.222198 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5424d232-e950-48f6-b729-30d0f1201c35 req-ed6ef161-86f2-4731-981e-bc99b4a56362 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0577118 Dec 09 14:47:51.271532 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5424d232-e950-48f6-b729-30d0f1201c35 req-becc4035-a1e9-4042-bc81-5f559e3ac133 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432611 Dec 09 14:47:52.192131 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9a28355-02e2-4e01-a5c0-50b46d19a392 req-172505a6-dd7e-4da7-beb0-863997c81ad7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:52.193647 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f9a28355-02e2-4e01-a5c0-50b46d19a392 req-172505a6-dd7e-4da7-beb0-863997c81ad7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0554433 Dec 09 14:47:52.259253 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f9a28355-02e2-4e01-a5c0-50b46d19a392 req-74d966bb-b4e2-4613-960f-550554303fd6 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0591407 Dec 09 14:47:52.399898 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38fc35d8-fb2c-4f5e-8aab-f55b68d3995f req-8e9004af-92d6-4100-92ab-5d7b65c1f509 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:52.401615 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-38fc35d8-fb2c-4f5e-8aab-f55b68d3995f req-8e9004af-92d6-4100-92ab-5d7b65c1f509 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0592113 Dec 09 14:47:52.457174 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-38fc35d8-fb2c-4f5e-8aab-f55b68d3995f req-8c83a7e1-6f9e-40fc-9017-b2ab1182d15a tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465620 Dec 09 14:47:53.395639 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25cf23a6-edba-42df-91c6-887f7fe91e56 req-914d9412-88e2-43ef-b97c-31839fa51e86 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:53.397411 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-25cf23a6-edba-42df-91c6-887f7fe91e56 req-914d9412-88e2-43ef-b97c-31839fa51e86 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0591385 Dec 09 14:47:53.460103 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-25cf23a6-edba-42df-91c6-887f7fe91e56 req-43b3d3cf-43a4-4627-822c-4d8f973074bf tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0565832 Dec 09 14:47:53.590391 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24413980-e18e-4c26-b11d-e2f7cf5c9fa3 req-2757c2bf-812a-4cac-b5e1-90da8468af90 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:53.597496 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-24413980-e18e-4c26-b11d-e2f7cf5c9fa3 req-2757c2bf-812a-4cac-b5e1-90da8468af90 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0709372 Dec 09 14:47:53.643634 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-24413980-e18e-4c26-b11d-e2f7cf5c9fa3 req-6e4bdf21-f9f3-4c14-9d8c-3305a428f2c6 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451853 Dec 09 14:47:54.590047 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c0f2e1c-6d34-4a9b-819b-6b4af2e1fe12 req-482b8c3c-0ea7-497e-b8cb-a40658c0a2d0 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:54.591558 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1c0f2e1c-6d34-4a9b-819b-6b4af2e1fe12 req-482b8c3c-0ea7-497e-b8cb-a40658c0a2d0 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0518546 Dec 09 14:47:54.660282 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-1c0f2e1c-6d34-4a9b-819b-6b4af2e1fe12 req-647fa4d8-3a14-46b0-ae20-3bad3a4431fd tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0624018 Dec 09 14:47:54.763054 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daf55105-7198-4ea8-b018-e8873b91ba7f req-6995ed44-a0f4-49bb-abd1-39f24c20863f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:54.764571 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-daf55105-7198-4ea8-b018-e8873b91ba7f req-6995ed44-a0f4-49bb-abd1-39f24c20863f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0510650 Dec 09 14:47:54.817373 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-daf55105-7198-4ea8-b018-e8873b91ba7f req-f7e97af9-59cc-4736-87c1-7b24894fe7c1 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445774 Dec 09 14:47:55.790937 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec2f9f57-7002-421c-9dc5-934dca060752 req-f592cc1e-17d9-41b6-9354-aa471a1396d6 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:55.792449 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ec2f9f57-7002-421c-9dc5-934dca060752 req-f592cc1e-17d9-41b6-9354-aa471a1396d6 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0524428 Dec 09 14:47:55.853019 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ec2f9f57-7002-421c-9dc5-934dca060752 req-9f2a4f45-c269-4161-8dc3-50a3fab41ebf tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0542631 Dec 09 14:47:55.968688 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64a8d177-f7e3-4e00-b27e-93cf706c32bc req-a555800a-df43-40ec-9cd9-9ac4bcf0b24c tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:55.970164 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-64a8d177-f7e3-4e00-b27e-93cf706c32bc req-a555800a-df43-40ec-9cd9-9ac4bcf0b24c tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0544670 Dec 09 14:47:56.023261 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-64a8d177-f7e3-4e00-b27e-93cf706c32bc req-717b7559-fbba-4292-b9ed-1496bfc324da tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440845 Dec 09 14:47:56.274953 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c814247-0f55-4dd3-b52a-2b97aa860153 req-16afd518-ce8d-4b7f-8246-c5d4a4dca121 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:56.276437 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6c814247-0f55-4dd3-b52a-2b97aa860153 req-16afd518-ce8d-4b7f-8246-c5d4a4dca121 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=10d73d0acf44499e88f6d53847b2094e&device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 1098 time: 0.0408239 Dec 09 14:47:56.369952 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c814247-0f55-4dd3-b52a-2b97aa860153 req-a6f571e0-9d40-4595-b637-dfd93066978d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:56.371467 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6c814247-0f55-4dd3-b52a-2b97aa860153 req-a6f571e0-9d40-4595-b637-dfd93066978d service neutron] 10.222.0.44 "GET /v2.0/networks?id=f0982548-601b-4206-88dc-a16a0317b421 HTTP/1.1" status: 200 len: 909 time: 0.0864356 Dec 09 14:47:56.699490 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6c814247-0f55-4dd3-b52a-2b97aa860153 req-da51021f-80c3-4b41-ad19-ec94f3efd359 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e44baa3b-39d9-4337-9599-d357f2381c7d HTTP/1.1" status: 200 len: 1001 time: 0.3131583 Dec 09 14:47:56.762633 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c814247-0f55-4dd3-b52a-2b97aa860153 req-b5448fa3-b0f0-4c1c-9136-d1e0297a43e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:56.764201 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6c814247-0f55-4dd3-b52a-2b97aa860153 req-b5448fa3-b0f0-4c1c-9136-d1e0297a43e0 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=7edf1e5e-d953-4e3c-8dc5-29475e258db2 HTTP/1.1" status: 200 len: 847 time: 0.0460505 Dec 09 14:47:56.820087 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c814247-0f55-4dd3-b52a-2b97aa860153 req-3adefa27-27a5-4156-9350-2363d1297127 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:56.821597 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6c814247-0f55-4dd3-b52a-2b97aa860153 req-3adefa27-27a5-4156-9350-2363d1297127 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=f0982548-601b-4206-88dc-a16a0317b421&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0451491 Dec 09 14:47:56.917768 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6c814247-0f55-4dd3-b52a-2b97aa860153 req-7dd4987a-5ac4-40d4-9926-1d4f92034c33 service neutron] 10.222.0.44 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0850921 Dec 09 14:47:57.002614 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-36f80110-3044-488f-a56f-8e0ed3000476 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:57.032742 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a6fd28c-8419-45f0-bf66-2cff02b28e04 req-fc9d7cea-e8e4-4e58-859f-168720678378 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:57.034313 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6a6fd28c-8419-45f0-bf66-2cff02b28e04 req-fc9d7cea-e8e4-4e58-859f-168720678378 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.1104341 Dec 09 14:47:57.058454 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6c814247-0f55-4dd3-b52a-2b97aa860153 req-88b4004e-e8a8-4036-bd5c-dca76b256273 service neutron] 10.222.0.44 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1257963 Dec 09 14:47:57.113317 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6a6fd28c-8419-45f0-bf66-2cff02b28e04 req-a36554cc-8cdd-46d3-a6aa-fd54ade542d7 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=b198c154-3d21-435b-8a30-9196034aed82&id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0709224 Dec 09 14:47:57.145645 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c929cd4-aa6c-4bd6-9a92-cc22f7744999 req-5a4785c5-22d0-4b6a-a2d7-1dccfd906dc0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:57.147121 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-9c929cd4-aa6c-4bd6-9a92-cc22f7744999 req-5a4785c5-22d0-4b6a-a2d7-1dccfd906dc0 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0483263 Dec 09 14:47:57.198356 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-9c929cd4-aa6c-4bd6-9a92-cc22f7744999 req-4f39fab6-8cd5-484c-9b0f-e6281d37edc4 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449998 Dec 09 14:47:58.321443 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb4e6a7d-205e-42ce-b1d7-c2a7038968e5 req-d6417a1a-4bf6-429f-b3e3-a03582214f85 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:58.322925 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-bb4e6a7d-205e-42ce-b1d7-c2a7038968e5 req-d6417a1a-4bf6-429f-b3e3-a03582214f85 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0507166 Dec 09 14:47:58.374195 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-bb4e6a7d-205e-42ce-b1d7-c2a7038968e5 req-16e1f471-5fa0-42e6-b15c-4cc5ca1f04d2 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448956 Dec 09 14:47:59.182071 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-156ccfdd-9128-4dc9-8651-33e0cf628edb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:47:59.501278 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df8ebeea-8d57-49ab-86d3-c6181abe47b3 req-ac5fa183-0bca-4f4b-8c3a-37852b0d2858 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:47:59.507121 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-df8ebeea-8d57-49ab-86d3-c6181abe47b3 req-ac5fa183-0bca-4f4b-8c3a-37852b0d2858 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0622716 Dec 09 14:47:59.555105 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-df8ebeea-8d57-49ab-86d3-c6181abe47b3 req-da56321b-e9b4-42ff-87af-ac8e7f9f0447 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444243 Dec 09 14:48:00.440758 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:00.671513 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7db35a61-12cd-429b-923d-1c16fd9a9cad req-8c714a92-884a-43e9-8d8e-707f4c452bdd tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:00.673035 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7db35a61-12cd-429b-923d-1c16fd9a9cad req-8c714a92-884a-43e9-8d8e-707f4c452bdd tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0483348 Dec 09 14:48:00.724152 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7db35a61-12cd-429b-923d-1c16fd9a9cad req-6e58d22e-8cd0-4ce5-acf9-c1e1d21722f1 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445619 Dec 09 14:48:00.824795 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 59580) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:00.946223 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b3bec675-5cf4-40a2-b439-744cca080fdd admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:00.963064 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-9addd047-5e26-45f7-b5a0-83945c4ef3c0 req-0509c545-de00-40f9-8a01-c16ad404a6eb service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0958209 Dec 09 14:48:00.978180 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ed38e19-f8ac-4671-9a79-2ba5bc4b7c9c req-bfb0e221-3eb6-465f-871d-7142047073c1 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:00.979652 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6ed38e19-f8ac-4671-9a79-2ba5bc4b7c9c req-bfb0e221-3eb6-465f-871d-7142047073c1 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0872040 Dec 09 14:48:01.060646 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6ed38e19-f8ac-4671-9a79-2ba5bc4b7c9c req-6d02674f-a282-4c1c-8a48-80d6888d31a8 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0625350 Dec 09 14:48:01.084361 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b3bec675-5cf4-40a2-b439-744cca080fdd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:01.089592 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b3bec675-5cf4-40a2-b439-744cca080fdd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:01.127806 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-b3bec675-5cf4-40a2-b439-744cca080fdd admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=09c53a38701b488cbf3763c75965f1cd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3017581 Dec 09 14:48:01.128992 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b3bec675-5cf4-40a2-b439-744cca080fdd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=12e82b00-853d-4fd1-897b-ac3f84ab2db5,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:01.130469 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 59590) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:01.185881 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:01.211006 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:01.258359 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:01.260966 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:01.262134 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/12e82b00-853d-4fd1-897b-ac3f84ab2db5 HTTP/1.1" status: 204 len: 168 time: 0.1305664 Dec 09 14:48:01.270862 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=12e82b00-853d-4fd1-897b-ac3f84ab2db5,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:01.279218 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:01.279581 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:01.279963 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:01.280309 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:01.280650 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:01.280990 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:01.281327 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:01.281667 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:01.282004 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:01.282342 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:01.282674 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:01.283004 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:01.283446 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8c74eb9a-6c2b-493f-899a-084a61402c1d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:01.739946 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 59618) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:01.804759 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:01.851525 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-337d19b2-a5fa-47b6-95d9-12cdfc5edf3a admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:01.928817 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-337d19b2-a5fa-47b6-95d9-12cdfc5edf3a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:01.933425 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-337d19b2-a5fa-47b6-95d9-12cdfc5edf3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:01.972051 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-337d19b2-a5fa-47b6-95d9-12cdfc5edf3a admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=04866eed0bcf47acb0b0ca951068d485&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2309709 Dec 09 14:48:01.972785 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-337d19b2-a5fa-47b6-95d9-12cdfc5edf3a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5768be58-fa29-4daf-ace3-256aacf157f7,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:01.975734 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 59622) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:02.028532 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ccf98d13-a6d8-4f0a-85d6-11b872defe9e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:02.051760 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ccf98d13-a6d8-4f0a-85d6-11b872defe9e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:02.101837 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ccf98d13-a6d8-4f0a-85d6-11b872defe9e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:02.104578 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ccf98d13-a6d8-4f0a-85d6-11b872defe9e admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:02.108510 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-ccf98d13-a6d8-4f0a-85d6-11b872defe9e admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/5768be58-fa29-4daf-ace3-256aacf157f7 HTTP/1.1" status: 204 len: 168 time: 0.1287568 Dec 09 14:48:02.114021 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccf98d13-a6d8-4f0a-85d6-11b872defe9e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5768be58-fa29-4daf-ace3-256aacf157f7,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:02.209364 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-112814e8-b32f-4067-ba3e-09a63a8f1bb6 req-804e86eb-0523-437a-b35e-ab3f3529f3cf tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:02.210889 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-112814e8-b32f-4067-ba3e-09a63a8f1bb6 req-804e86eb-0523-437a-b35e-ab3f3529f3cf tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0520210 Dec 09 14:48:02.265004 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-112814e8-b32f-4067-ba3e-09a63a8f1bb6 req-29e7f3ea-618a-42bd-a7e2-5c11ed9c454d tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444520 Dec 09 14:48:02.477041 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9addd047-5e26-45f7-b5a0-83945c4ef3c0 req-74b73968-f68e-41e9-ba3b-be5670be4ce5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:02.479191 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9addd047-5e26-45f7-b5a0-83945c4ef3c0 req-74b73968-f68e-41e9-ba3b-be5670be4ce5 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593&tenant_id=10d73d0acf44499e88f6d53847b2094e HTTP/1.1" status: 200 len: 1098 time: 0.0425353 Dec 09 14:48:02.545860 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9addd047-5e26-45f7-b5a0-83945c4ef3c0 req-dfeeedd2-d37a-4745-a46c-8ab1e6911c8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:02.547379 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9addd047-5e26-45f7-b5a0-83945c4ef3c0 req-dfeeedd2-d37a-4745-a46c-8ab1e6911c8b service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=10d73d0acf44499e88f6d53847b2094e&device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 1098 time: 0.0450950 Dec 09 14:48:02.616085 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:02.642612 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9addd047-5e26-45f7-b5a0-83945c4ef3c0 req-3b56df52-6310-4b05-aa7e-02e3396fd86f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:02.644181 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9addd047-5e26-45f7-b5a0-83945c4ef3c0 req-3b56df52-6310-4b05-aa7e-02e3396fd86f service neutron] 10.222.0.44 "GET /v2.0/networks?id=f0982548-601b-4206-88dc-a16a0317b421 HTTP/1.1" status: 200 len: 909 time: 0.0897369 Dec 09 14:48:02.719473 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9addd047-5e26-45f7-b5a0-83945c4ef3c0 req-f4a8af40-2b28-4040-a48c-b73470d31d87 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e44baa3b-39d9-4337-9599-d357f2381c7d HTTP/1.1" status: 200 len: 1001 time: 0.0659502 Dec 09 14:48:02.729749 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device e44baa3b-39d9-4337-9599-d357f2381c7d no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:48:02.784951 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9addd047-5e26-45f7-b5a0-83945c4ef3c0 req-4b29ab2c-ce40-478f-b873-0b432980ae65 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:02.786584 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9addd047-5e26-45f7-b5a0-83945c4ef3c0 req-4b29ab2c-ce40-478f-b873-0b432980ae65 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=7edf1e5e-d953-4e3c-8dc5-29475e258db2 HTTP/1.1" status: 200 len: 847 time: 0.0527813 Dec 09 14:48:02.811805 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:02.838379 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e44baa3b-39d9-4337-9599-d357f2381c7d'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:48:02.840945 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e4252b0b-49dd-4661-8508-4716eb867dec" -d '{"events": [{"server_uuid": "fb81e6b3-1e55-4186-be5b-5f51f6563593", "name": "network-vif-unplugged", "status": "completed", "tag": "e44baa3b-39d9-4337-9599-d357f2381c7d"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:48:02.843112 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9addd047-5e26-45f7-b5a0-83945c4ef3c0 req-ec484b01-4ff5-4166-8241-b279c2f2b257 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:02.844840 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9addd047-5e26-45f7-b5a0-83945c4ef3c0 req-ec484b01-4ff5-4166-8241-b279c2f2b257 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=f0982548-601b-4206-88dc-a16a0317b421&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0474248 Dec 09 14:48:02.861290 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port e44baa3b-39d9-4337-9599-d357f2381c7d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=e44baa3b-39d9-4337-9599-d357f2381c7d,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:48:02.866993 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:02.896410 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 09 Dec 2021 14:48:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-924469ab-203a-4e0c-875c-8e18d1d03e0f x-openstack-request-id: req-924469ab-203a-4e0c-875c-8e18d1d03e0f {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:48:02.896715 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fb81e6b3-1e55-4186-be5b-5f51f6563593", "name": "network-vif-unplugged", "status": "completed", "tag": "e44baa3b-39d9-4337-9599-d357f2381c7d", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:48:02.896972 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-924469ab-203a-4e0c-875c-8e18d1d03e0f {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:48:02.897367 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'e44baa3b-39d9-4337-9599-d357f2381c7d', 'code': 200} Dec 09 14:48:02.921843 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=e44baa3b-39d9-4337-9599-d357f2381c7d,revision_number=6']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:02.946819 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9addd047-5e26-45f7-b5a0-83945c4ef3c0 req-aba8d2df-ddfd-4ed4-b2df-12e13df81f1c service neutron] 10.222.0.44 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0941472 Dec 09 14:48:03.038630 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9addd047-5e26-45f7-b5a0-83945c4ef3c0 req-bbe94c9d-6b43-4fe1-9990-e240b22878ad service neutron] 10.222.0.44 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838232 Dec 09 14:48:03.383913 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf47ce7b-dcfe-4272-888d-dd449ec36c69 req-e3ab97a4-6743-49da-9609-eabf1c2e975b tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:03.385493 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bf47ce7b-dcfe-4272-888d-dd449ec36c69 req-e3ab97a4-6743-49da-9609-eabf1c2e975b tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 943 time: 0.0506260 Dec 09 14:48:03.439495 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bf47ce7b-dcfe-4272-888d-dd449ec36c69 req-77f1dc85-d3d5-40fa-a681-c9e647f8728f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0482266 Dec 09 14:48:04.566717 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58db9800-d90d-4266-8d2e-dd8aa382c087 req-09fa581e-68d1-480f-9c90-333dd0d3fd24 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:04.568238 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-58db9800-d90d-4266-8d2e-dd8aa382c087 req-09fa581e-68d1-480f-9c90-333dd0d3fd24 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 943 time: 0.0576735 Dec 09 14:48:04.623231 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-58db9800-d90d-4266-8d2e-dd8aa382c087 req-8411e911-7ebb-48d0-b096-384b18d2e8d2 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0488293 Dec 09 14:48:05.740280 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95753acb-76e5-49a0-8dd0-82c9ba2510c8 req-1a0a2670-5eca-40fc-a7e6-56d8e4e9817f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:05.741822 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-95753acb-76e5-49a0-8dd0-82c9ba2510c8 req-1a0a2670-5eca-40fc-a7e6-56d8e4e9817f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 943 time: 0.0508819 Dec 09 14:48:05.792258 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-95753acb-76e5-49a0-8dd0-82c9ba2510c8 req-63c7704c-f13c-4164-a64a-03e0be70799b tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439491 Dec 09 14:48:06.920158 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02788810-9023-4c5a-8e69-a818c0388ab4 req-e41447c7-d4f6-4944-8376-036faab93173 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:06.921628 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-02788810-9023-4c5a-8e69-a818c0388ab4 req-e41447c7-d4f6-4944-8376-036faab93173 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 943 time: 0.0564804 Dec 09 14:48:06.971586 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-02788810-9023-4c5a-8e69-a818c0388ab4 req-8edf490d-ac69-4db5-84b1-d88cc7546914 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431795 Dec 09 14:48:08.091264 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc76c6dd-9e67-4452-9b18-d43e339b1df7 req-c096bdbd-3a2c-4525-b27a-19a3ec07e1b3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:08.092791 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fc76c6dd-9e67-4452-9b18-d43e339b1df7 req-c096bdbd-3a2c-4525-b27a-19a3ec07e1b3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 943 time: 0.0516722 Dec 09 14:48:08.148689 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fc76c6dd-9e67-4452-9b18-d43e339b1df7 req-800076f1-d7f5-4259-87ac-6d231dd49f02 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470395 Dec 09 14:48:09.275938 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7e6c304-df01-450c-a4ab-738304d905c5 req-57c70e48-b8fd-42d7-953b-7c14cf2b3f58 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:09.277446 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b7e6c304-df01-450c-a4ab-738304d905c5 req-57c70e48-b8fd-42d7-953b-7c14cf2b3f58 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 943 time: 0.0532546 Dec 09 14:48:09.337322 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b7e6c304-df01-450c-a4ab-738304d905c5 req-e2ab35d3-5838-4d91-aa55-e8b3ddc64370 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0512412 Dec 09 14:48:09.552517 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a47791bf-12c8-4481-b785-a80436401420 req-94e24688-93e4-493c-998e-4b7e5781d3fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:09.554170 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a47791bf-12c8-4481-b785-a80436401420 req-94e24688-93e4-493c-998e-4b7e5781d3fa service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 1096 time: 0.0436716 Dec 09 14:48:09.607512 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a47791bf-12c8-4481-b785-a80436401420 req-f302eb1c-ef7c-4a5a-b63b-739621d9c062 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422940 Dec 09 14:48:10.457942 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8597a6e-6e27-4007-ac8a-3e2bc529fada req-9c72ec55-631a-4fc3-b962-68537ee47fba tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:10.459557 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a8597a6e-6e27-4007-ac8a-3e2bc529fada req-9c72ec55-631a-4fc3-b962-68537ee47fba tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 943 time: 0.0515268 Dec 09 14:48:10.479229 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53659d11-66db-467f-824d-d256329a2299 req-c3283345-d1a0-48f4-a06f-218d13243426 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:10.480619 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-53659d11-66db-467f-824d-d256329a2299 req-c3283345-d1a0-48f4-a06f-218d13243426 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0485954 Dec 09 14:48:10.511346 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a8597a6e-6e27-4007-ac8a-3e2bc529fada req-e5048dde-0378-405b-93ed-2c86df90e385 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452228 Dec 09 14:48:10.532573 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-53659d11-66db-467f-824d-d256329a2299 req-df6c11f9-7a9e-41f5-80ac-71bdda9273ec tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458329 Dec 09 14:48:10.750151 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device e44baa3b-39d9-4337-9599-d357f2381c7d details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:48:10.854013 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port e44baa3b-39d9-4337-9599-d357f2381c7d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=e44baa3b-39d9-4337-9599-d357f2381c7d,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:48:10.866279 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': 'e44baa3b-39d9-4337-9599-d357f2381c7d', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'port_id': 'e44baa3b-39d9-4337-9599-d357f2381c7d', 'mac_address': 'fa:16:3e:16:eb:3e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 449, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:48:10.904034 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:10.917168 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e44baa3b-39d9-4337-9599-d357f2381c7d {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:48:10.936723 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port e44baa3b-39d9-4337-9599-d357f2381c7d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=e44baa3b-39d9-4337-9599-d357f2381c7d,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:48:10.942070 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:10.990532 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=e44baa3b-39d9-4337-9599-d357f2381c7d,revision_number=7']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:11.290156 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['e44baa3b-39d9-4337-9599-d357f2381c7d'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:48:11.635632 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55f3700b-e040-42e6-9ef8-5fa4fe992446 req-00d45c27-b50a-4c9f-a8cd-3a792ebf2cad tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:11.637253 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-55f3700b-e040-42e6-9ef8-5fa4fe992446 req-00d45c27-b50a-4c9f-a8cd-3a792ebf2cad tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 944 time: 0.0569425 Dec 09 14:48:11.664734 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-865d2b54-4728-4aa3-9f32-d3c8681e5d58 req-d0e12892-7293-4b38-a8a6-456374645b50 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:11.666201 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-865d2b54-4728-4aa3-9f32-d3c8681e5d58 req-d0e12892-7293-4b38-a8a6-456374645b50 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0575769 Dec 09 14:48:11.688645 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-55f3700b-e040-42e6-9ef8-5fa4fe992446 req-d1ca4eaa-3a8d-4d8f-9b09-7cf42377bf4f tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450721 Dec 09 14:48:11.731629 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-865d2b54-4728-4aa3-9f32-d3c8681e5d58 req-96f29db4-4637-47a1-b377-abf4ad89e2ae tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0588822 Dec 09 14:48:12.860616 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5266bc7c-d17a-4b12-b465-a93ed7a4907f req-558e6d98-0718-4c93-b49d-adb8bffd2a63 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:12.862535 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5266bc7c-d17a-4b12-b465-a93ed7a4907f req-558e6d98-0718-4c93-b49d-adb8bffd2a63 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0580575 Dec 09 14:48:12.891195 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device e44baa3b-39d9-4337-9599-d357f2381c7d up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:48:12.913727 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5266bc7c-d17a-4b12-b465-a93ed7a4907f req-44a3a938-4d45-4b25-9fae-434007804a78 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=9a3248f4-1741-4d7a-a680-075df7d725b8&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449004 Dec 09 14:48:12.938193 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port e44baa3b-39d9-4337-9599-d357f2381c7d triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:48:12.938568 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:13.015141 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:13.040189 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e44baa3b-39d9-4337-9599-d357f2381c7d'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:48:13.042509 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd1831ef-d80e-4015-a695-8adf318f705b" -d '{"events": [{"server_uuid": "fb81e6b3-1e55-4186-be5b-5f51f6563593", "name": "network-vif-plugged", "status": "completed", "tag": "e44baa3b-39d9-4337-9599-d357f2381c7d"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:48:13.056066 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port e44baa3b-39d9-4337-9599-d357f2381c7d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=e44baa3b-39d9-4337-9599-d357f2381c7d,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:48:13.061352 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:13.109988 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=e44baa3b-39d9-4337-9599-d357f2381c7d,revision_number=8']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:13.199216 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:48:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5110eb01-56c7-4285-9075-06eaaf1e1da6 x-openstack-request-id: req-5110eb01-56c7-4285-9075-06eaaf1e1da6 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:48:13.199538 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fb81e6b3-1e55-4186-be5b-5f51f6563593", "name": "network-vif-plugged", "status": "completed", "tag": "e44baa3b-39d9-4337-9599-d357f2381c7d", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:48:13.199879 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-5110eb01-56c7-4285-9075-06eaaf1e1da6 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:48:13.200290 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e44baa3b-39d9-4337-9599-d357f2381c7d', 'code': 200} Dec 09 14:48:13.410903 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-f816c676-51f6-4bb6-8b25-bec79627f54e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:13.412285 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-f816c676-51f6-4bb6-8b25-bec79627f54e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.44 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 945 time: 0.0567656 Dec 09 14:48:13.513534 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-bc0d4dbb-cae0-461d-9f0a-d59762450f12 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Deleting port c5d8b8cc-2c67-46a7-867d-276136fccdf1 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:48:13.513852 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-bc0d4dbb-cae0-461d-9f0a-d59762450f12 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:13.615413 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-bc0d4dbb-cae0-461d-9f0a-d59762450f12 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] For port c5d8b8cc-2c67-46a7-867d-276136fccdf1, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=c5d8b8cc-2c67-46a7-867d-276136fccdf1,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:48:13.615817 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-bc0d4dbb-cae0-461d-9f0a-d59762450f12 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:13.791851 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-bc0d4dbb-cae0-461d-9f0a-d59762450f12 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:13.792220 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-bc0d4dbb-cae0-461d-9f0a-d59762450f12 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:13.792531 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.l3_db [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-bc0d4dbb-cae0-461d-9f0a-d59762450f12 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Floating IP 4d08e902-ab2c-438b-a206-5afe09074fbe disassociated. External IP: 172.27.0.16, port: c5d8b8cc-2c67-46a7-867d-276136fccdf1. Dec 09 14:48:13.792882 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-bc0d4dbb-cae0-461d-9f0a-d59762450f12 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Calling delete_port for c5d8b8cc-2c67-46a7-867d-276136fccdf1 owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:48:13.925239 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-bc0d4dbb-cae0-461d-9f0a-d59762450f12 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:13.953452 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc0d4dbb-cae0-461d-9f0a-d59762450f12 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event deleted for resources: {'Port': ['ID=c5d8b8cc-2c67-46a7-867d-276136fccdf1,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:14.034754 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8c32e6d6-c4d2-48fe-abc1-a650515f9334 req-5af44e7f-8618-4a75-bf17-e2309e95538e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=31f6f258-99da-4d63-b6dd-0b20015bf98e HTTP/1.1" status: 200 len: 210 time: 0.0263927 Dec 09 14:48:14.078197 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-bc0d4dbb-cae0-461d-9f0a-d59762450f12 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Router 55e9791c-df4d-4622-ba5c-87f71cd3c12b has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:48:14.189207 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-bc0d4dbb-cae0-461d-9f0a-d59762450f12 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:48:14.199880 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfe98808-ae3a-44b5-b983-7511b3c9b040 None None] Sync routers for ids ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:48:14.209430 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfe98808-ae3a-44b5-b983-7511b3c9b040 None None] Routers {'55e9791c-df4d-4622-ba5c-87f71cd3c12b'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:48:14.210062 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-bfe98808-ae3a-44b5-b983-7511b3c9b040 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:47:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:48:14.229689 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-bc0d4dbb-cae0-461d-9f0a-d59762450f12 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] No DVR routers for this DVR port c5d8b8cc-2c67-46a7-867d-276136fccdf1 on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:48:14.232583 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-bc0d4dbb-cae0-461d-9f0a-d59762450f12 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:14.235926 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b8eb8017-8eb6-4a93-82de-57729f415832 req-bc0d4dbb-cae0-461d-9f0a-d59762450f12 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.44 "DELETE /v2.0/ports/c5d8b8cc-2c67-46a7-867d-276136fccdf1 HTTP/1.1" status: 204 len: 173 time: 0.8139260 Dec 09 14:48:14.236466 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '31f6f258-99da-4d63-b6dd-0b20015bf98e', 'name': 'network-vif-deleted', 'tag': 'c5d8b8cc-2c67-46a7-867d-276136fccdf1'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:48:14.238869 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0d0e4be4-a5d0-4665-ac27-aa6022e91c5f" -d '{"events": [{"server_uuid": "31f6f258-99da-4d63-b6dd-0b20015bf98e", "name": "network-vif-deleted", "tag": "c5d8b8cc-2c67-46a7-867d-276136fccdf1"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:48:14.334160 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-bfe98808-ae3a-44b5-b983-7511b3c9b040 None None] Set router 55e9791c-df4d-4622-ba5c-87f71cd3c12b gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:48:14.350499 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:48:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f69b71ce-66a2-402a-9451-f5e22ac81b56 x-openstack-request-id: req-f69b71ce-66a2-402a-9451-f5e22ac81b56 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:48:14.350797 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "31f6f258-99da-4d63-b6dd-0b20015bf98e", "name": "network-vif-deleted", "tag": "c5d8b8cc-2c67-46a7-867d-276136fccdf1", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:48:14.351051 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-f69b71ce-66a2-402a-9451-f5e22ac81b56 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:48:14.351455 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '31f6f258-99da-4d63-b6dd-0b20015bf98e', 'name': 'network-vif-deleted', 'tag': 'c5d8b8cc-2c67-46a7-867d-276136fccdf1', 'status': 'completed', 'code': 200} Dec 09 14:48:14.548292 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-bfe98808-ae3a-44b5-b983-7511b3c9b040 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'ade23a8f-bc90-4df9-9f92-95d4b4587037', 'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'mac_address': 'fa:16:3e:65:b3:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 124, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:58Z', 'revision_number': 5, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'subnets': [{'id': '4b7e026c-4454-4200-91c3-30d27a976452', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:48:14.578070 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfe98808-ae3a-44b5-b983-7511b3c9b040 None None] Checking router: 55e9791c-df4d-4622-ba5c-87f71cd3c12b for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:48:14.588008 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfe98808-ae3a-44b5-b983-7511b3c9b040 None None] Routers {'55e9791c-df4d-4622-ba5c-87f71cd3c12b'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:48:14.588625 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-bfe98808-ae3a-44b5-b983-7511b3c9b040 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:47:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:48:14.694342 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-bfe98808-ae3a-44b5-b983-7511b3c9b040 None None] Set router 55e9791c-df4d-4622-ba5c-87f71cd3c12b gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:48:14.844752 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:14.910984 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-bfe98808-ae3a-44b5-b983-7511b3c9b040 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'ade23a8f-bc90-4df9-9f92-95d4b4587037', 'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'mac_address': 'fa:16:3e:65:b3:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 124, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:58Z', 'revision_number': 5, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'subnets': [{'id': '4b7e026c-4454-4200-91c3-30d27a976452', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:48:14.948295 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfe98808-ae3a-44b5-b983-7511b3c9b040 None None] The sync data for ids ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'] in dv-cinder-819692-8-iscsi is: [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'ade23a8f-bc90-4df9-9f92-95d4b4587037', 'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'mac_address': 'fa:16:3e:65:b3:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 124, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:58Z', 'revision_number': 5, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'subnets': [{'id': '4b7e026c-4454-4200-91c3-30d27a976452', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:48:15.132128 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 59802) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:15.189850 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-60c01287-1bc2-4fb6-8d65-0d11a9a2ad1b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:15.194105 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5e10f5b-bd11-4e7b-a967-a0ffe8fac80e None None] New status for floating IP 4d08e902-ab2c-438b-a206-5afe09074fbe: DOWN {{(pid=109064) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:48:15.214065 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-60c01287-1bc2-4fb6-8d65-0d11a9a2ad1b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:15.267154 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-60c01287-1bc2-4fb6-8d65-0d11a9a2ad1b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:15.269980 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-60c01287-1bc2-4fb6-8d65-0d11a9a2ad1b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:15.272402 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-60c01287-1bc2-4fb6-8d65-0d11a9a2ad1b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "DELETE /v2.0/security-groups/9a3248f4-1741-4d7a-a680-075df7d725b8 HTTP/1.1" status: 204 len: 168 time: 0.1387262 Dec 09 14:48:15.274730 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 59804) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:15.289545 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60c01287-1bc2-4fb6-8d65-0d11a9a2ad1b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a3248f4-1741-4d7a-a680-075df7d725b8,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:15.291059 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.api.v2.resource [None req-26250857-8e6a-4d5f-acaf-6d74198f07fd tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] show failed (client error): The resource could not be found. Dec 09 14:48:15.295263 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-26250857-8e6a-4d5f-acaf-6d74198f07fd tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups/9a3248f4-1741-4d7a-a680-075df7d725b8 HTTP/1.1" status: 404 len: 347 time: 0.0195360 Dec 09 14:48:15.295357 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 59806) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:15.425964 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-e038e5b6-ef1d-4d4e-a9c6-6ef2acaa456f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Deleting port ef9a7156-f6f9-4f11-bac3-da1e7ccfd754 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:48:15.426346 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e038e5b6-ef1d-4d4e-a9c6-6ef2acaa456f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:15.502350 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e038e5b6-ef1d-4d4e-a9c6-6ef2acaa456f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:15.502746 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e038e5b6-ef1d-4d4e-a9c6-6ef2acaa456f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:15.515540 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-e038e5b6-ef1d-4d4e-a9c6-6ef2acaa456f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Calling delete_port for ef9a7156-f6f9-4f11-bac3-da1e7ccfd754 owned by network:floatingip {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:48:15.663395 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e038e5b6-ef1d-4d4e-a9c6-6ef2acaa456f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:15.688239 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e038e5b6-ef1d-4d4e-a9c6-6ef2acaa456f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event deleted for resources: {'Port': ['ID=ef9a7156-f6f9-4f11-bac3-da1e7ccfd754,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:15.751397 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e038e5b6-ef1d-4d4e-a9c6-6ef2acaa456f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for floatingip, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:15.753935 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e038e5b6-ef1d-4d4e-a9c6-6ef2acaa456f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:15.755120 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-e038e5b6-ef1d-4d4e-a9c6-6ef2acaa456f tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "DELETE /v2.0/floatingips/4d08e902-ab2c-438b-a206-5afe09074fbe HTTP/1.1" status: 204 len: 168 time: 0.4585879 Dec 09 14:48:16.219369 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 59814) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:16.224101 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-f417aca9-2c23-4d01-85bc-0c76726bb83e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Request body: {'security_group': {'name': 'tempest-securitygroup--792068982', 'description': 'tempest-description--81129657'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:48:16.250243 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f417aca9-2c23-4d01-85bc-0c76726bb83e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:16.323265 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f417aca9-2c23-4d01-85bc-0c76726bb83e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:16.329542 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f417aca9-2c23-4d01-85bc-0c76726bb83e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:16.359977 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f417aca9-2c23-4d01-85bc-0c76726bb83e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event updated for resources: {'SecurityGroup': ['ID=927687a4-aeb0-458e-b110-0ce356cf2037,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:16.364336 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f417aca9-2c23-4d01-85bc-0c76726bb83e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:16.368199 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-f417aca9-2c23-4d01-85bc-0c76726bb83e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1794 time: 0.1451173 Dec 09 14:48:16.369266 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 59816) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:16.373360 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-bcceacfc-6999-4170-9d3b-cd1df145aa63 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Request body: {'security_group_rule': {'security_group_id': '927687a4-aeb0-458e-b110-0ce356cf2037', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:48:16.405094 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-bcceacfc-6999-4170-9d3b-cd1df145aa63 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:16.463708 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-bcceacfc-6999-4170-9d3b-cd1df145aa63 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:16.468945 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-bcceacfc-6999-4170-9d3b-cd1df145aa63 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:16.486969 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bcceacfc-6999-4170-9d3b-cd1df145aa63 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ad3dc0c7-f573-47f1-abe3-9e7167f46ecf,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:16.497162 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-bcceacfc-6999-4170-9d3b-cd1df145aa63 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:16.498371 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-bcceacfc-6999-4170-9d3b-cd1df145aa63 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1290126 Dec 09 14:48:16.501122 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 59818) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:16.505454 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-f2dd404c-328d-4868-8eb0-710ee6c5afcb tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Request body: {'security_group_rule': {'security_group_id': '927687a4-aeb0-458e-b110-0ce356cf2037', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:48:16.534677 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f2dd404c-328d-4868-8eb0-710ee6c5afcb tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:16.596662 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f2dd404c-328d-4868-8eb0-710ee6c5afcb tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:16.601659 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f2dd404c-328d-4868-8eb0-710ee6c5afcb tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:16.620642 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2dd404c-328d-4868-8eb0-710ee6c5afcb tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=9ea94452-d47e-4e58-97cc-b1ca2ce94f0c,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:16.627700 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f2dd404c-328d-4868-8eb0-710ee6c5afcb tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:16.628941 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-f2dd404c-328d-4868-8eb0-710ee6c5afcb tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1268775 Dec 09 14:48:16.632141 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 59820) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:16.636808 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Request body: {'floatingip': {'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:48:16.660412 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for floatingip, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:16.760132 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:16.776356 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device c5d8b8cc-2c67-46a7-867d-276136fccdf1 no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:48:16.797762 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: c5d8b8cc-2c67-46a7-867d-276136fccdf1 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:48:16.798102 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device c5d8b8cc-2c67-46a7-867d-276136fccdf1 not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:48:16.868068 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Allocated IP 172.27.0.75 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/f4928cda-04c2-49c8-bcd5-2edcf840d729) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:48:16.969917 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:17.012085 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:17.052366 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:48:17.057151 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:48:17.061742 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:48:17.067474 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event updated for resources: {'Port': ['ID=f4928cda-04c2-49c8-bcd5-2edcf840d729,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:17.150009 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:17.184683 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:17.338864 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:17.346578 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:17.413881 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event updated for resources: {'Port': ['ID=f4928cda-04c2-49c8-bcd5-2edcf840d729,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:17.427551 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:17.444889 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:17.446225 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-b835789d-715f-4d79-b6a6-edfa817322b2 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 0.8131163 Dec 09 14:48:17.599091 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-cf46aab7-6968-47ef-8077-aea4ab0f56e5 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?name=tempest-securitygroup--792068982&fields=id&tenant_id=a538bf01cb5440ffa06b6873f212efaa HTTP/1.1" status: 200 len: 267 time: 0.0455525 Dec 09 14:48:17.709927 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-69c9f4c6-d197-4ab0-b5ca-4c8dbb5bcb81 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:17.711407 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-69c9f4c6-d197-4ab0-b5ca-4c8dbb5bcb81 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/networks?id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b HTTP/1.1" status: 200 len: 810 time: 0.1052895 Dec 09 14:48:17.728686 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-c3573444-bb53-43dd-a8f8-dcd0abc4229a tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/quotas/a538bf01cb5440ffa06b6873f212efaa HTTP/1.1" status: 200 len: 375 time: 0.0095096 Dec 09 14:48:17.779239 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-3b106365-1525-4eba-acc2-37f02f259e4e tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=a538bf01cb5440ffa06b6873f212efaa&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0451744 Dec 09 14:48:17.973574 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-8d612175-eb8d-418f-a8d9-fd663d0ea4b6 service neutron] 10.222.0.39 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1827843 Dec 09 14:48:18.065799 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-12aa920c-c104-43ce-8545-c3df82950722 service neutron] 10.222.0.39 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859170 Dec 09 14:48:18.239145 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b99cf7ab-4d14-44ae-9330-0c174996adae req-af52c2d2-aba1-4c01-a692-4164a4876bb6 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 210 time: 0.0273213 Dec 09 14:48:19.277602 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-fa2d2f97-edfd-43ca-b4a7-dc88c4082a73 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:19.279230 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-fa2d2f97-edfd-43ca-b4a7-dc88c4082a73 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.44 "GET /v2.0/networks?id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b HTTP/1.1" status: 200 len: 810 time: 0.1008344 Dec 09 14:48:19.345531 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e6b81ab9-25af-4569-8f7c-76db7dfa71ec req-9b84f2f6-9dda-45c3-949f-63d239fb8016 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 210 time: 0.0370843 Dec 09 14:48:19.371339 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-ec4bbfdf-a68b-4421-845a-70ba9be2156d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.44 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=a538bf01cb5440ffa06b6873f212efaa HTTP/1.1" status: 200 len: 379 time: 0.0797348 Dec 09 14:48:19.382957 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1bfbb52b-639f-4b88-82e9-105fafa360a8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Request body: {'port': {'device_id': '16803667-78ca-4e38-97ce-e51fa14c3825', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'admin_state_up': True, 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'security_groups': ['927687a4-aeb0-458e-b110-0ce356cf2037']}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:48:19.496009 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1bfbb52b-639f-4b88-82e9-105fafa360a8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Made reservation on behalf of a538bf01cb5440ffa06b6873f212efaa for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:48:19.499543 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1bfbb52b-639f-4b88-82e9-105fafa360a8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:19.635027 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1bfbb52b-639f-4b88-82e9-105fafa360a8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Allocated IP 172.20.0.7 (1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b/4b7e026c-4454-4200-91c3-30d27a976452/aa786f00-e147-482f-b4af-854ade7971b7) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:48:19.785124 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1bfbb52b-639f-4b88-82e9-105fafa360a8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:20.064972 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1bfbb52b-639f-4b88-82e9-105fafa360a8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:20.107235 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1bfbb52b-639f-4b88-82e9-105fafa360a8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:48:20.112297 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1bfbb52b-639f-4b88-82e9-105fafa360a8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:48:20.115983 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1bfbb52b-639f-4b88-82e9-105fafa360a8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:48:20.140664 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bfbb52b-639f-4b88-82e9-105fafa360a8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event updated for resources: {'Port': ['ID=aa786f00-e147-482f-b4af-854ade7971b7,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:20.169483 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1bfbb52b-639f-4b88-82e9-105fafa360a8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:20.170104 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1bfbb52b-639f-4b88-82e9-105fafa360a8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:20.187759 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1bfbb52b-639f-4b88-82e9-105fafa360a8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8083267 Dec 09 14:48:20.214400 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Request body: {'port': {'device_id': '16803667-78ca-4e38-97ce-e51fa14c3825', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:48:20.274024 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:20.382749 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-604cf16e-bd48-4d3b-9e87-e79d8f93efa3 None None] Provisioning complete for port aa786f00-e147-482f-b4af-854ade7971b7 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:48:20.383202 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-604cf16e-bd48-4d3b-9e87-e79d8f93efa3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:20.418250 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-604cf16e-bd48-4d3b-9e87-e79d8f93efa3 None None] Port aa786f00-e147-482f-b4af-854ade7971b7 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:48:20.518297 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8179ea7e-49fd-4852-b2a5-bf0fdf43669d req-885d2683-4820-4782-99f3-825c145becc8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:20.519802 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8179ea7e-49fd-4852-b2a5-bf0fdf43669d req-885d2683-4820-4782-99f3-825c145becc8 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 931 time: 0.1033828 Dec 09 14:48:20.610533 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8179ea7e-49fd-4852-b2a5-bf0fdf43669d req-728c0ea9-3c5e-496a-8771-d9d4943b717d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=927687a4-aeb0-458e-b110-0ce356cf2037&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0806687 Dec 09 14:48:20.618501 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id aa786f00-e147-482f-b4af-854ade7971b7 {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:48:20.627521 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:20.641337 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Transition to ACTIVE for port object aa786f00-e147-482f-b4af-854ade7971b7 will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:48:20.646068 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:20.696557 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Pushing event updated for resources: {'Port': ['ID=aa786f00-e147-482f-b4af-854ade7971b7,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:20.765865 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Attempting to bind port aa786f00-e147-482f-b4af-854ade7971b7 on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:48:20.766205 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Attempting to bind port aa786f00-e147-482f-b4af-854ade7971b7 by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:48:20.766532 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Attempting to bind port aa786f00-e147-482f-b4af-854ade7971b7 on network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:48:20.771232 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Port aa786f00-e147-482f-b4af-854ade7971b7 on network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:48:20.771555 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Attempting to bind port aa786f00-e147-482f-b4af-854ade7971b7 on network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:48:20.776599 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 48, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:48:20.776934 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Checking segment: {'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:48:20.777314 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Bound using segment: {'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:48:20.777738 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Bound port: aa786f00-e147-482f-b4af-854ade7971b7, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '249aca58-f120-4349-ac3d-e3bc6b709d78', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 442, 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:48:20.778091 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:20.846963 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] For port aa786f00-e147-482f-b4af-854ade7971b7, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:48:20.850386 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] For port aa786f00-e147-482f-b4af-854ade7971b7, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=aa786f00-e147-482f-b4af-854ade7971b7,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:48:20.858061 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:20.894339 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:20.894994 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:20.896509 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] 10.222.0.44 "PUT /v2.0/ports/aa786f00-e147-482f-b4af-854ade7971b7 HTTP/1.1" status: 200 len: 1093 time: 0.6865833 Dec 09 14:48:20.896952 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16803667-78ca-4e38-97ce-e51fa14c3825', 'tag': 'aa786f00-e147-482f-b4af-854ade7971b7'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:48:20.899565 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c1285cdb-5270-45bf-9dc9-7837e9591051" -d '{"events": [{"name": "network-changed", "server_uuid": "16803667-78ca-4e38-97ce-e51fa14c3825", "tag": "aa786f00-e147-482f-b4af-854ade7971b7"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:48:20.933851 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e785da1-717a-468e-9b31-6387bc39f72d service neutron] Pushing event updated for resources: {'Port': ['ID=aa786f00-e147-482f-b4af-854ade7971b7,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:20.973446 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:48:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-467da18f-3253-4aac-a4d9-02b03c901c45 x-openstack-request-id: req-467da18f-3253-4aac-a4d9-02b03c901c45 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:48:20.973743 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "16803667-78ca-4e38-97ce-e51fa14c3825", "tag": "aa786f00-e147-482f-b4af-854ade7971b7", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:48:20.974000 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-467da18f-3253-4aac-a4d9-02b03c901c45 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:48:20.974421 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '16803667-78ca-4e38-97ce-e51fa14c3825', 'tag': 'aa786f00-e147-482f-b4af-854ade7971b7', 'status': 'completed', 'code': 200} Dec 09 14:48:21.008853 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-cb3444d7-9f16-4985-bb19-d3b69c67c033 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:21.010437 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-cb3444d7-9f16-4985-bb19-d3b69c67c033 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=a538bf01cb5440ffa06b6873f212efaa&device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 1096 time: 0.0461152 Dec 09 14:48:21.062915 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-1c86d4ee-d3c7-48d8-9246-d7f0cb3d6b64 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=aa786f00-e147-482f-b4af-854ade7971b7 HTTP/1.1" status: 200 len: 217 time: 0.0400925 Dec 09 14:48:21.113138 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-714743e9-5c33-4c06-8f4c-1fa0bf1fd80e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:21.114587 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-714743e9-5c33-4c06-8f4c-1fa0bf1fd80e service neutron] 10.222.0.44 "GET /v2.0/subnets?id=4b7e026c-4454-4200-91c3-30d27a976452 HTTP/1.1" status: 200 len: 849 time: 0.0429184 Dec 09 14:48:21.161278 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-64224595-913f-4410-98a5-d3324675e72a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:21.162704 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-64224595-913f-4410-98a5-d3324675e72a service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0402887 Dec 09 14:48:21.264385 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-5a3f500e-c57c-4746-8f06-f5fbdd2d66b7 service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0930309 Dec 09 14:48:21.366673 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-54acdef5-6e27-411d-91b4-7d926d863e26 req-200dc5fb-b664-4297-be33-aa3c5586d7f7 service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0946636 Dec 09 14:48:21.460009 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1285cdb-5270-45bf-9dc9-7837e9591051 req-20ebd922-3da1-4d0b-ae8c-f5c84733af2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:21.461422 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c1285cdb-5270-45bf-9dc9-7837e9591051 req-20ebd922-3da1-4d0b-ae8c-f5c84733af2e service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=a538bf01cb5440ffa06b6873f212efaa&device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 1096 time: 0.0424199 Dec 09 14:48:21.556024 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1285cdb-5270-45bf-9dc9-7837e9591051 req-06111076-82f2-4cfa-9b26-9855f8cd8991 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:21.557465 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c1285cdb-5270-45bf-9dc9-7837e9591051 req-06111076-82f2-4cfa-9b26-9855f8cd8991 service neutron] 10.222.0.44 "GET /v2.0/networks?id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b HTTP/1.1" status: 200 len: 911 time: 0.0886109 Dec 09 14:48:21.600025 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c1285cdb-5270-45bf-9dc9-7837e9591051 req-fe7845b5-4ee6-43bb-9c27-f47f14702e1e service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=aa786f00-e147-482f-b4af-854ade7971b7 HTTP/1.1" status: 200 len: 217 time: 0.0343449 Dec 09 14:48:21.658007 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1285cdb-5270-45bf-9dc9-7837e9591051 req-bb1fad35-b6b5-4880-8972-061d6ddcd5b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:21.659555 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c1285cdb-5270-45bf-9dc9-7837e9591051 req-bb1fad35-b6b5-4880-8972-061d6ddcd5b2 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=4b7e026c-4454-4200-91c3-30d27a976452 HTTP/1.1" status: 200 len: 849 time: 0.0504692 Dec 09 14:48:21.714488 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1285cdb-5270-45bf-9dc9-7837e9591051 req-496619f8-12b4-462d-ae1c-04c8039e3c14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:21.720236 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c1285cdb-5270-45bf-9dc9-7837e9591051 req-496619f8-12b4-462d-ae1c-04c8039e3c14 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0446553 Dec 09 14:48:21.745853 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f71d21d7-2a5a-400d-8087-13514e376571 req-921ff2e1-bd12-4983-bae3-ce167f65d6f7 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:21.747740 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f71d21d7-2a5a-400d-8087-13514e376571 req-921ff2e1-bd12-4983-bae3-ce167f65d6f7 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 943 time: 0.0569067 Dec 09 14:48:21.800560 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f71d21d7-2a5a-400d-8087-13514e376571 req-0a8101a4-80c6-483a-90a1-aceb33b9dca3 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=927687a4-aeb0-458e-b110-0ce356cf2037&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0456762 Dec 09 14:48:21.815993 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c1285cdb-5270-45bf-9dc9-7837e9591051 req-cce090fa-c19a-43b8-a227-fd70afb5f4c5 service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0837851 Dec 09 14:48:21.908499 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c1285cdb-5270-45bf-9dc9-7837e9591051 req-30c63a15-0513-4b4c-b7c6-043fa7f50f6e service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839796 Dec 09 14:48:22.448702 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:48:22.932871 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e60a472a-faa7-4bae-ae84-475148d2ff03 req-5e7f4798-7742-4df7-8504-d850352af38d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:22.934406 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e60a472a-faa7-4bae-ae84-475148d2ff03 req-5e7f4798-7742-4df7-8504-d850352af38d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 943 time: 0.0616422 Dec 09 14:48:22.983586 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e60a472a-faa7-4bae-ae84-475148d2ff03 req-bb3a91bd-9be8-4fc1-9244-2e0469331561 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=927687a4-aeb0-458e-b110-0ce356cf2037&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432315 Dec 09 14:48:24.112288 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de40703b-7894-4641-a549-de4d844ac13a req-cd67077f-5c37-4722-8218-95a30423fb64 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:24.113774 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-de40703b-7894-4641-a549-de4d844ac13a req-cd67077f-5c37-4722-8218-95a30423fb64 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 943 time: 0.0516908 Dec 09 14:48:24.162011 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-de40703b-7894-4641-a549-de4d844ac13a req-6e5ba544-e026-4c66-bef7-b30dc4433351 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=927687a4-aeb0-458e-b110-0ce356cf2037&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0413876 Dec 09 14:48:25.296233 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32634b99-4a1e-44f0-bf98-44fedde8a9bd req-112bbdc4-6af5-4b2f-b234-0836eb566010 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:25.297719 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-32634b99-4a1e-44f0-bf98-44fedde8a9bd req-112bbdc4-6af5-4b2f-b234-0836eb566010 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 943 time: 0.0537705 Dec 09 14:48:25.345383 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-32634b99-4a1e-44f0-bf98-44fedde8a9bd req-a4a45f66-bfb1-4cbe-8779-3a73981db5af tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=927687a4-aeb0-458e-b110-0ce356cf2037&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415738 Dec 09 14:48:25.739632 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device aa786f00-e147-482f-b4af-854ade7971b7 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:48:25.838413 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port aa786f00-e147-482f-b4af-854ade7971b7, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=aa786f00-e147-482f-b4af-854ade7971b7,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:48:25.849772 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': 'aa786f00-e147-482f-b4af-854ade7971b7', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'port_id': 'aa786f00-e147-482f-b4af-854ade7971b7', 'mac_address': 'fa:16:3e:84:9a:c1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 442, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:48:25.889666 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:25.902133 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id aa786f00-e147-482f-b4af-854ade7971b7 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:48:25.921952 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port aa786f00-e147-482f-b4af-854ade7971b7, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=aa786f00-e147-482f-b4af-854ade7971b7,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:48:25.929159 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:25.974461 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=aa786f00-e147-482f-b4af-854ade7971b7,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:25.981446 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:25.981796 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:25.982138 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:25.982477 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:25.982804 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:25.983127 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:25.983454 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:25.983839 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:25.984161 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:25.984484 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:25.984807 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:25.985109 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:25.985424 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:26.461592 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5894e73-ddf2-48e7-b2d6-1c01e9e4ca72 req-0926fc7f-9c20-4ae0-863a-eb1b49cbd194 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:26.463063 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d5894e73-ddf2-48e7-b2d6-1c01e9e4ca72 req-0926fc7f-9c20-4ae0-863a-eb1b49cbd194 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 944 time: 0.0498116 Dec 09 14:48:26.512767 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d5894e73-ddf2-48e7-b2d6-1c01e9e4ca72 req-46157bc8-43a6-4717-ab8f-aa1eccf10d07 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=927687a4-aeb0-458e-b110-0ce356cf2037&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435967 Dec 09 14:48:27.019094 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-fde003a0-435b-49ff-97b5-cac000b53e91 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:27.102539 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['aa786f00-e147-482f-b4af-854ade7971b7'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:48:27.521118 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d06d759-6456-46d0-8ed6-86db1a748b1e req-39e32170-7344-4dfb-8fdb-703590b75318 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:27.522627 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2d06d759-6456-46d0-8ed6-86db1a748b1e req-39e32170-7344-4dfb-8fdb-703590b75318 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0515492 Dec 09 14:48:27.569124 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2d06d759-6456-46d0-8ed6-86db1a748b1e req-a7b89b5a-9eb3-4d40-8562-6d51a0979af4 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403101 Dec 09 14:48:27.635511 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b389ba6c-b21f-4b49-9863-a7efc66cc01f req-ac730d50-2238-43c4-bf59-f8ae66b2706a tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:27.637016 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b389ba6c-b21f-4b49-9863-a7efc66cc01f req-ac730d50-2238-43c4-bf59-f8ae66b2706a tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 944 time: 0.0499971 Dec 09 14:48:27.685481 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b389ba6c-b21f-4b49-9863-a7efc66cc01f req-3ab63818-369b-4e0b-b9de-f6b565c24dd6 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=927687a4-aeb0-458e-b110-0ce356cf2037&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422952 Dec 09 14:48:28.698716 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46b93b53-5417-456c-a73a-c5baaf22b94f req-1ed83bb6-6d59-427d-b0aa-800d53f51796 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:28.700285 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-46b93b53-5417-456c-a73a-c5baaf22b94f req-1ed83bb6-6d59-427d-b0aa-800d53f51796 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0521309 Dec 09 14:48:28.751920 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-46b93b53-5417-456c-a73a-c5baaf22b94f req-ed14a8c1-174e-4607-b7cf-a84e75e246b5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433855 Dec 09 14:48:28.801484 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e53b74-e6db-4b71-94b7-c1619f745cd2 req-f3e49387-379d-4354-a381-b872acf22073 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:28.802938 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-08e53b74-e6db-4b71-94b7-c1619f745cd2 req-f3e49387-379d-4354-a381-b872acf22073 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 944 time: 0.0488338 Dec 09 14:48:28.853918 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-08e53b74-e6db-4b71-94b7-c1619f745cd2 req-5539b54d-a4ad-419b-b87a-b67ce7cf1378 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=927687a4-aeb0-458e-b110-0ce356cf2037&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449469 Dec 09 14:48:28.868986 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device aa786f00-e147-482f-b4af-854ade7971b7 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:48:28.923668 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port aa786f00-e147-482f-b4af-854ade7971b7 completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:48:28.928047 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port aa786f00-e147-482f-b4af-854ade7971b7 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:48:28.928422 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:29.003481 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:29.028649 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16803667-78ca-4e38-97ce-e51fa14c3825', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa786f00-e147-482f-b4af-854ade7971b7'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:48:29.031002 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-53a550d9-a883-4a71-bc7a-7e25e8d884c2" -d '{"events": [{"server_uuid": "16803667-78ca-4e38-97ce-e51fa14c3825", "name": "network-vif-plugged", "status": "completed", "tag": "aa786f00-e147-482f-b4af-854ade7971b7"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:48:29.043927 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port aa786f00-e147-482f-b4af-854ade7971b7, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=aa786f00-e147-482f-b4af-854ade7971b7,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:48:29.053788 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:29.078804 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:48:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-02a4429f-bcda-4bc2-af83-5ec983584da3 x-openstack-request-id: req-02a4429f-bcda-4bc2-af83-5ec983584da3 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:48:29.079108 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16803667-78ca-4e38-97ce-e51fa14c3825", "name": "network-vif-plugged", "status": "completed", "tag": "aa786f00-e147-482f-b4af-854ade7971b7", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:48:29.079364 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-02a4429f-bcda-4bc2-af83-5ec983584da3 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:48:29.079873 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16803667-78ca-4e38-97ce-e51fa14c3825', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'aa786f00-e147-482f-b4af-854ade7971b7', 'code': 200} Dec 09 14:48:29.106845 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=aa786f00-e147-482f-b4af-854ade7971b7,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:29.188270 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-0eb25165-9510-4585-8a0f-9fbf766ad086 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:29.278374 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-328981ac-ab92-4275-93f0-eb9e3d080cc9 req-2d03df1b-a7d5-4d45-87fd-9c86bffc59b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:29.279923 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-328981ac-ab92-4275-93f0-eb9e3d080cc9 req-2d03df1b-a7d5-4d45-87fd-9c86bffc59b0 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 1098 time: 0.0419409 Dec 09 14:48:29.326001 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-328981ac-ab92-4275-93f0-eb9e3d080cc9 req-46ef22d7-3749-4535-b6b6-827950c50600 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=927687a4-aeb0-458e-b110-0ce356cf2037&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0384018 Dec 09 14:48:29.872101 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daf29faf-424b-47a2-a8b1-15790970f967 req-76a718bf-ed3e-4736-b027-c1606cf05073 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:29.873742 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-daf29faf-424b-47a2-a8b1-15790970f967 req-76a718bf-ed3e-4736-b027-c1606cf05073 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0501423 Dec 09 14:48:29.929370 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-daf29faf-424b-47a2-a8b1-15790970f967 req-25cc38ac-27d3-4c82-80c2-cb8455a3acd3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0491378 Dec 09 14:48:30.008962 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19a36f6a-7201-49f6-bbb3-891da7f74195 req-286beffb-e153-4406-96c8-934f47cc85dc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:30.010725 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-19a36f6a-7201-49f6-bbb3-891da7f74195 req-286beffb-e153-4406-96c8-934f47cc85dc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 945 time: 0.0524864 Dec 09 14:48:30.058189 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-19a36f6a-7201-49f6-bbb3-891da7f74195 req-2d08dadb-b006-4acb-8b37-7744dfbcea54 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=927687a4-aeb0-458e-b110-0ce356cf2037&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410922 Dec 09 14:48:30.442663 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:31.069434 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-928eade9-d12d-4b66-b011-7cb4d41fcc0a req-fb242424-be3a-40e4-830b-7cc65628e07f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:31.070933 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-928eade9-d12d-4b66-b011-7cb4d41fcc0a req-fb242424-be3a-40e4-830b-7cc65628e07f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0538256 Dec 09 14:48:31.122012 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-928eade9-d12d-4b66-b011-7cb4d41fcc0a req-25e4dd28-ade5-4191-8a60-26adff2c3313 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449545 Dec 09 14:48:31.174190 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f0db4ec-8caa-4e25-8a36-6c48a7108b3b req-bbd929db-6fc4-42ae-a6dc-31e4418e81a1 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:31.175994 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7f0db4ec-8caa-4e25-8a36-6c48a7108b3b req-bbd929db-6fc4-42ae-a6dc-31e4418e81a1 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 945 time: 0.0493147 Dec 09 14:48:31.226478 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7f0db4ec-8caa-4e25-8a36-6c48a7108b3b req-4e120e0c-75c9-446c-a628-ba255c1d48bc tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=927687a4-aeb0-458e-b110-0ce356cf2037&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433836 Dec 09 14:48:31.344243 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ea2fcad-c83b-4457-8025-3af0f2f63075 req-f5f24d72-c6ce-47a9-9541-1c6838d96a84 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:31.345801 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6ea2fcad-c83b-4457-8025-3af0f2f63075 req-f5f24d72-c6ce-47a9-9541-1c6838d96a84 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 945 time: 0.0494134 Dec 09 14:48:31.355371 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 59986) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:31.361936 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-08f737be-6c93-47f2-8430-26e86d6a7310 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Request body: {'floatingip': {'port_id': 'aa786f00-e147-482f-b4af-854ade7971b7'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:48:31.407143 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-08f737be-6c93-47f2-8430-26e86d6a7310 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for floatingip, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:31.811581 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:31.844070 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-08f737be-6c93-47f2-8430-26e86d6a7310 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:31.850229 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-08f737be-6c93-47f2-8430-26e86d6a7310 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:31.950181 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.l3_db [None req-08f737be-6c93-47f2-8430-26e86d6a7310 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Floating IP 8c911938-4c2f-4ad8-a14e-02e817758c6d associated. External IP: 172.27.0.75, port: aa786f00-e147-482f-b4af-854ade7971b7. Dec 09 14:48:32.167959 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-08f737be-6c93-47f2-8430-26e86d6a7310 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Router 55e9791c-df4d-4622-ba5c-87f71cd3c12b has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:48:32.242454 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b005a52f-5618-447b-af27-5d82ac8206d7 req-bf984239-3599-4366-88e3-fe56bb3d8e7d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:32.244071 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b005a52f-5618-447b-af27-5d82ac8206d7 req-bf984239-3599-4366-88e3-fe56bb3d8e7d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0499878 Dec 09 14:48:32.279662 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-08f737be-6c93-47f2-8430-26e86d6a7310 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:48:32.285133 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-08f737be-6c93-47f2-8430-26e86d6a7310 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:32.293568 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d6c9f04-5d77-41dd-9441-a97470a87124 None None] Sync routers for ids ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:48:32.302485 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b005a52f-5618-447b-af27-5d82ac8206d7 req-cde01e1e-e358-40f3-a92f-c0a4499529d3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492897 Dec 09 14:48:32.303511 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d6c9f04-5d77-41dd-9441-a97470a87124 None None] Routers {'55e9791c-df4d-4622-ba5c-87f71cd3c12b'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:48:32.304225 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-2d6c9f04-5d77-41dd-9441-a97470a87124 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:48:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:48:32.313315 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-08f737be-6c93-47f2-8430-26e86d6a7310 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "PUT /v2.0/floatingips/8c911938-4c2f-4ad8-a14e-02e817758c6d HTTP/1.1" status: 200 len: 990 time: 0.9566393 Dec 09 14:48:32.313987 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '16803667-78ca-4e38-97ce-e51fa14c3825', 'tag': 'aa786f00-e147-482f-b4af-854ade7971b7'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:48:32.316755 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2fd8cea9-36b6-47f0-bdda-89c238590a94" -d '{"events": [{"name": "network-changed", "server_uuid": "16803667-78ca-4e38-97ce-e51fa14c3825", "tag": "aa786f00-e147-482f-b4af-854ade7971b7"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:48:32.362778 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:48:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4d19d8c8-bcc7-4bb1-bf75-65d1e47cd6a5 x-openstack-request-id: req-4d19d8c8-bcc7-4bb1-bf75-65d1e47cd6a5 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:48:32.363103 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "16803667-78ca-4e38-97ce-e51fa14c3825", "tag": "aa786f00-e147-482f-b4af-854ade7971b7", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:48:32.363364 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-4d19d8c8-bcc7-4bb1-bf75-65d1e47cd6a5 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:48:32.363804 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '16803667-78ca-4e38-97ce-e51fa14c3825', 'tag': 'aa786f00-e147-482f-b4af-854ade7971b7', 'status': 'completed', 'code': 200} Dec 09 14:48:32.543297 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-2d6c9f04-5d77-41dd-9441-a97470a87124 None None] Set router 55e9791c-df4d-4622-ba5c-87f71cd3c12b gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:48:32.644500 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:32.777029 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-2d6c9f04-5d77-41dd-9441-a97470a87124 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '8c911938-4c2f-4ad8-a14e-02e817758c6d', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'floating_ip_address': '172.27.0.75', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'port_id': 'aa786f00-e147-482f-b4af-854ade7971b7', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'mac_address': 'fa:16:3e:84:9a:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16803667-78ca-4e38-97ce-e51fa14c3825', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:48:17Z', 'updated_at': '2021-12-09T14:48:31Z', 'revision_number': 1, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ade23a8f-bc90-4df9-9f92-95d4b4587037', 'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'mac_address': 'fa:16:3e:65:b3:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 124, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:58Z', 'revision_number': 5, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'subnets': [{'id': '4b7e026c-4454-4200-91c3-30d27a976452', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:48:32.803102 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d6c9f04-5d77-41dd-9441-a97470a87124 None None] Checking router: 55e9791c-df4d-4622-ba5c-87f71cd3c12b for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:48:32.813127 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d6c9f04-5d77-41dd-9441-a97470a87124 None None] Routers {'55e9791c-df4d-4622-ba5c-87f71cd3c12b'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:48:32.813759 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-2d6c9f04-5d77-41dd-9441-a97470a87124 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:48:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:48:32.927041 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-2d6c9f04-5d77-41dd-9441-a97470a87124 None None] Set router 55e9791c-df4d-4622-ba5c-87f71cd3c12b gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:48:33.152294 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-2d6c9f04-5d77-41dd-9441-a97470a87124 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '8c911938-4c2f-4ad8-a14e-02e817758c6d', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'floating_ip_address': '172.27.0.75', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'port_id': 'aa786f00-e147-482f-b4af-854ade7971b7', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'mac_address': 'fa:16:3e:84:9a:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16803667-78ca-4e38-97ce-e51fa14c3825', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:48:17Z', 'updated_at': '2021-12-09T14:48:31Z', 'revision_number': 1, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ade23a8f-bc90-4df9-9f92-95d4b4587037', 'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'mac_address': 'fa:16:3e:65:b3:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 124, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:58Z', 'revision_number': 5, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'subnets': [{'id': '4b7e026c-4454-4200-91c3-30d27a976452', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:48:33.181770 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2d6c9f04-5d77-41dd-9441-a97470a87124 None None] The sync data for ids ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'] in dv-cinder-819692-8-iscsi is: [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '8c911938-4c2f-4ad8-a14e-02e817758c6d', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'floating_ip_address': '172.27.0.75', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'port_id': 'aa786f00-e147-482f-b4af-854ade7971b7', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 549, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'mac_address': 'fa:16:3e:84:9a:c1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '16803667-78ca-4e38-97ce-e51fa14c3825', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:48:17Z', 'updated_at': '2021-12-09T14:48:31Z', 'revision_number': 1, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'ade23a8f-bc90-4df9-9f92-95d4b4587037', 'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'mac_address': 'fa:16:3e:65:b3:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 124, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:58Z', 'revision_number': 5, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'subnets': [{'id': '4b7e026c-4454-4200-91c3-30d27a976452', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:48:33.383091 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a91040b5-a63c-4b6f-8ff1-535edbf6115e None None] New status for floating IP 8c911938-4c2f-4ad8-a14e-02e817758c6d: ACTIVE {{(pid=109064) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:48:33.438342 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cbea40ef-776b-40c1-8fb0-0fa0119917da req-6f9f2673-0196-4904-b241-dba48e87f184 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:33.439853 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-cbea40ef-776b-40c1-8fb0-0fa0119917da req-6f9f2673-0196-4904-b241-dba48e87f184 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0468640 Dec 09 14:48:33.488059 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-cbea40ef-776b-40c1-8fb0-0fa0119917da req-1343639b-d838-4321-83c9-f96b615eff62 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415175 Dec 09 14:48:34.624058 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-996d23b7-9b35-41c4-9ff7-5d26c033e6a2 req-91b0f6f4-0239-4a4b-9bd2-0192c29448e5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:34.625584 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-996d23b7-9b35-41c4-9ff7-5d26c033e6a2 req-91b0f6f4-0239-4a4b-9bd2-0192c29448e5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0592084 Dec 09 14:48:34.675437 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-996d23b7-9b35-41c4-9ff7-5d26c033e6a2 req-e92d0e14-a66e-45db-bbdc-16fe1f16b1bd tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410025 Dec 09 14:48:34.986059 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fd8cea9-36b6-47f0-bdda-89c238590a94 req-1def7bfc-8910-4924-a87a-37a237221150 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:34.987647 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2fd8cea9-36b6-47f0-bdda-89c238590a94 req-1def7bfc-8910-4924-a87a-37a237221150 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=a538bf01cb5440ffa06b6873f212efaa&device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 1098 time: 0.0604994 Dec 09 14:48:35.092280 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fd8cea9-36b6-47f0-bdda-89c238590a94 req-2494f7f4-78a4-4643-80c2-550befb3e535 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:35.093878 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2fd8cea9-36b6-47f0-bdda-89c238590a94 req-2494f7f4-78a4-4643-80c2-550befb3e535 service neutron] 10.222.0.44 "GET /v2.0/networks?id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b HTTP/1.1" status: 200 len: 911 time: 0.0945468 Dec 09 14:48:35.161705 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2fd8cea9-36b6-47f0-bdda-89c238590a94 req-1cd70a33-1886-4620-a9b1-eb3f88c9c375 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=aa786f00-e147-482f-b4af-854ade7971b7 HTTP/1.1" status: 200 len: 1000 time: 0.0602336 Dec 09 14:48:35.221975 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fd8cea9-36b6-47f0-bdda-89c238590a94 req-f95e929e-6ffc-466a-89fd-97a83bc4da85 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:35.223317 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2fd8cea9-36b6-47f0-bdda-89c238590a94 req-f95e929e-6ffc-466a-89fd-97a83bc4da85 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=4b7e026c-4454-4200-91c3-30d27a976452 HTTP/1.1" status: 200 len: 849 time: 0.0459402 Dec 09 14:48:35.270293 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fd8cea9-36b6-47f0-bdda-89c238590a94 req-8d5450b4-a095-4760-acf7-047fe4355fb7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:35.271792 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2fd8cea9-36b6-47f0-bdda-89c238590a94 req-8d5450b4-a095-4760-acf7-047fe4355fb7 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0401316 Dec 09 14:48:35.370979 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2fd8cea9-36b6-47f0-bdda-89c238590a94 req-910aab98-1da8-4026-81ad-ccab1b51be34 service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0907564 Dec 09 14:48:35.475094 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2fd8cea9-36b6-47f0-bdda-89c238590a94 req-ea6f182b-4ccf-45df-99c5-3ed86f121c7e service neutron] 10.222.0.44 "GET /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0966597 Dec 09 14:48:35.828335 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af56264b-1c45-4f75-a254-70b5a41c00ea req-e29a6bf3-ba0b-469f-b2a5-0c332153c464 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:35.829961 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-af56264b-1c45-4f75-a254-70b5a41c00ea req-e29a6bf3-ba0b-469f-b2a5-0c332153c464 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0590944 Dec 09 14:48:35.877952 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-af56264b-1c45-4f75-a254-70b5a41c00ea req-ec4a54a7-1133-48ab-933b-3778efb155e7 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417488 Dec 09 14:48:37.017533 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5b478d7-bfe1-4844-9a0a-561c17bf9ddb req-338a452c-db4c-46b7-9967-a0f1693829f6 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:37.018974 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b5b478d7-bfe1-4844-9a0a-561c17bf9ddb req-338a452c-db4c-46b7-9967-a0f1693829f6 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0557010 Dec 09 14:48:37.068136 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b5b478d7-bfe1-4844-9a0a-561c17bf9ddb req-bbc2cd05-aaef-4392-a563-f186e5618b4f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430763 Dec 09 14:48:38.191345 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2763bf06-9008-479b-a7aa-55da81345d67 req-cdab0b21-5581-4859-9226-e8fd8c0a0be2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:38.192816 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2763bf06-9008-479b-a7aa-55da81345d67 req-cdab0b21-5581-4859-9226-e8fd8c0a0be2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0493798 Dec 09 14:48:38.244428 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2763bf06-9008-479b-a7aa-55da81345d67 req-da135ac8-94a2-42f2-a698-eccd5d328e59 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440013 Dec 09 14:48:39.369074 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7a546c7-fe67-4adf-8ea8-51e26e79608d req-d2a08605-c8e9-4976-bb8c-597b463b53f1 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:39.370804 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c7a546c7-fe67-4adf-8ea8-51e26e79608d req-d2a08605-c8e9-4976-bb8c-597b463b53f1 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0534363 Dec 09 14:48:39.418103 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c7a546c7-fe67-4adf-8ea8-51e26e79608d req-7be16fd8-ba38-4f21-a98e-1ad39ccdd114 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411673 Dec 09 14:48:40.544990 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ada9466-c617-4560-a123-470008af6878 req-265679ed-8c2e-4d32-92fe-878c581b2802 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:40.546484 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0ada9466-c617-4560-a123-470008af6878 req-265679ed-8c2e-4d32-92fe-878c581b2802 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0554490 Dec 09 14:48:40.596425 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0ada9466-c617-4560-a123-470008af6878 req-b7beed49-1f90-4f71-9a45-25f8a1c242c7 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410292 Dec 09 14:48:41.350443 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60066) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:41.472761 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d44c758d-17d3-4bf7-9889-262c5bdf15d0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:41.549294 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d44c758d-17d3-4bf7-9889-262c5bdf15d0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:41.556051 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d44c758d-17d3-4bf7-9889-262c5bdf15d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:41.597281 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-d44c758d-17d3-4bf7-9889-262c5bdf15d0 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=5d11359718f6418e89cb0678f61bb947&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2453077 Dec 09 14:48:41.598730 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d44c758d-17d3-4bf7-9889-262c5bdf15d0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef1f827b-169a-4a65-b618-39342a9f88bf,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:41.599701 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60072) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:41.656051 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:41.681386 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:41.754314 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecc79d40-bb9c-4144-90d8-d2299175dec9 req-655c1f3c-496c-4b2f-9573-6a630b9f9246 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:41.756196 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ecc79d40-bb9c-4144-90d8-d2299175dec9 req-655c1f3c-496c-4b2f-9573-6a630b9f9246 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0778332 Dec 09 14:48:41.780230 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:41.782803 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:41.783937 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/ef1f827b-169a-4a65-b618-39342a9f88bf HTTP/1.1" status: 204 len: 168 time: 0.1830232 Dec 09 14:48:41.800929 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef1f827b-169a-4a65-b618-39342a9f88bf,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:41.812147 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:41.812499 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:41.812846 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:41.813247 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:41.813584 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:41.813950 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:41.814524 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:41.814889 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:41.815226 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:41.815561 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:41.815929 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:41.816245 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:41.816572 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-506e078d-3e2e-4748-944b-ba38f888f29a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:48:41.833634 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ecc79d40-bb9c-4144-90d8-d2299175dec9 req-32aa6adf-1650-41ff-9193-167c3b570c1e tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0716119 Dec 09 14:48:42.965729 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ad3a80e-3a56-45b3-a25b-f46adf67bfb8 req-20a7eefc-e924-40f7-83e3-307cea7d9c31 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:42.967199 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3ad3a80e-3a56-45b3-a25b-f46adf67bfb8 req-20a7eefc-e924-40f7-83e3-307cea7d9c31 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0551178 Dec 09 14:48:43.019995 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3ad3a80e-3a56-45b3-a25b-f46adf67bfb8 req-b5f19930-03a4-433c-8d23-becef3d25a24 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463338 Dec 09 14:48:44.150893 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55a69c46-77ba-4af8-a80c-2c3139c8b2c9 req-dfa67bd5-871e-40d9-bc52-d6ac74615f8a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:44.152292 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-55a69c46-77ba-4af8-a80c-2c3139c8b2c9 req-dfa67bd5-871e-40d9-bc52-d6ac74615f8a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0501599 Dec 09 14:48:44.201025 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-55a69c46-77ba-4af8-a80c-2c3139c8b2c9 req-8215185c-4ffc-4184-921e-7c1078aea73f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400734 Dec 09 14:48:44.833463 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:45.327352 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014d97d4-40a4-4769-95b8-9522fc08cc22 req-8d4d3cd1-4c73-4174-90e5-9341e6f5f2b6 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:45.328828 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-014d97d4-40a4-4769-95b8-9522fc08cc22 req-8d4d3cd1-4c73-4174-90e5-9341e6f5f2b6 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0499289 Dec 09 14:48:45.386497 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-014d97d4-40a4-4769-95b8-9522fc08cc22 req-a881197e-ef66-4fd0-a10a-d2e09a387c32 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493119 Dec 09 14:48:46.138324 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-accbb6e4-242a-4fcb-b9b0-ebcec61c0899 req-4cf0b0c4-cbcf-4cd6-92f3-98219d8eafa3 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0418267 Dec 09 14:48:46.217826 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accbb6e4-242a-4fcb-b9b0-ebcec61c0899 req-0c0de39c-def6-4ad5-ae98-03c9178fe650 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:46.219311 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-accbb6e4-242a-4fcb-b9b0-ebcec61c0899 req-0c0de39c-def6-4ad5-ae98-03c9178fe650 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=10d73d0acf44499e88f6d53847b2094e&device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 1098 time: 0.0466776 Dec 09 14:48:46.333941 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accbb6e4-242a-4fcb-b9b0-ebcec61c0899 req-d5ceff80-6652-4064-a00b-21b818a0eeeb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:46.335352 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-accbb6e4-242a-4fcb-b9b0-ebcec61c0899 req-d5ceff80-6652-4064-a00b-21b818a0eeeb service neutron] 10.222.0.44 "GET /v2.0/networks?id=f0982548-601b-4206-88dc-a16a0317b421 HTTP/1.1" status: 200 len: 909 time: 0.0896726 Dec 09 14:48:46.411758 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-accbb6e4-242a-4fcb-b9b0-ebcec61c0899 req-2db909b0-8c74-4b00-9b54-56512a6f360b service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e44baa3b-39d9-4337-9599-d357f2381c7d HTTP/1.1" status: 200 len: 1001 time: 0.0668380 Dec 09 14:48:46.465296 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accbb6e4-242a-4fcb-b9b0-ebcec61c0899 req-62759840-3d21-4738-9b2c-d376749c1869 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:46.466777 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-accbb6e4-242a-4fcb-b9b0-ebcec61c0899 req-62759840-3d21-4738-9b2c-d376749c1869 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=7edf1e5e-d953-4e3c-8dc5-29475e258db2 HTTP/1.1" status: 200 len: 847 time: 0.0454323 Dec 09 14:48:46.509556 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4454e4a6-45d5-41f3-ac1e-9e9ab59b9035 req-40f62da2-11c5-4abd-b0d4-6fd9098c9f5f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:46.511193 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4454e4a6-45d5-41f3-ac1e-9e9ab59b9035 req-40f62da2-11c5-4abd-b0d4-6fd9098c9f5f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0495517 Dec 09 14:48:46.515836 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accbb6e4-242a-4fcb-b9b0-ebcec61c0899 req-18703911-a965-48b5-a64e-5b7a8c60ece4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:46.517320 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-accbb6e4-242a-4fcb-b9b0-ebcec61c0899 req-18703911-a965-48b5-a64e-5b7a8c60ece4 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=f0982548-601b-4206-88dc-a16a0317b421&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0421779 Dec 09 14:48:46.557566 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4454e4a6-45d5-41f3-ac1e-9e9ab59b9035 req-c578b4c8-ccea-48c4-bc23-1400aeec9395 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0403163 Dec 09 14:48:46.617236 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-accbb6e4-242a-4fcb-b9b0-ebcec61c0899 req-3aa3d2d7-e194-4250-a9aa-6f396080fac6 service neutron] 10.222.0.44 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0875189 Dec 09 14:48:46.722142 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-accbb6e4-242a-4fcb-b9b0-ebcec61c0899 req-040f3e93-9524-4aa8-b5b5-3215036c9b26 service neutron] 10.222.0.44 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0957744 Dec 09 14:48:47.678891 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17026e6e-9387-451f-a1a7-aa5fd392d405 req-91ddb596-8cc1-46de-b455-18c529510088 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:47.680364 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-17026e6e-9387-451f-a1a7-aa5fd392d405 req-91ddb596-8cc1-46de-b455-18c529510088 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0506656 Dec 09 14:48:47.738523 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-17026e6e-9387-451f-a1a7-aa5fd392d405 req-be06c40c-dfb4-4532-bcaf-913322f718be tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494027 Dec 09 14:48:48.875565 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bb1d043-b806-47bc-9c30-c8bf8957f212 req-ffdd9ef0-ecdc-407c-805b-48af03cb8459 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:48.877038 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0bb1d043-b806-47bc-9c30-c8bf8957f212 req-ffdd9ef0-ecdc-407c-805b-48af03cb8459 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0526476 Dec 09 14:48:48.923121 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0bb1d043-b806-47bc-9c30-c8bf8957f212 req-4f82771d-d7b4-4be1-92d1-58818d4c77f7 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0400453 Dec 09 14:48:48.993427 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device d37591e8-0953-4fbc-9688-71f4c813e43c details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:48:49.095353 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port d37591e8-0953-4fbc-9688-71f4c813e43c, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=d37591e8-0953-4fbc-9688-71f4c813e43c,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:48:49.108675 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'port_id': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'mac_address': 'fa:16:3e:86:68:b2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 412, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:48:49.145994 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:49.162172 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id d37591e8-0953-4fbc-9688-71f4c813e43c {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:48:49.180998 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port d37591e8-0953-4fbc-9688-71f4c813e43c, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=d37591e8-0953-4fbc-9688-71f4c813e43c,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:48:49.187703 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:49.247792 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=d37591e8-0953-4fbc-9688-71f4c813e43c,revision_number=6']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:49.298563 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['d37591e8-0953-4fbc-9688-71f4c813e43c'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:48:50.045110 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54855818-2430-40c1-ad4f-4f9d50981f5f req-da74b71c-bfe0-430b-87e6-f917322adba2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:50.046639 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-54855818-2430-40c1-ad4f-4f9d50981f5f req-da74b71c-bfe0-430b-87e6-f917322adba2 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 945 time: 0.0491686 Dec 09 14:48:50.092753 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-54855818-2430-40c1-ad4f-4f9d50981f5f req-1c90b087-0fce-4889-a7b7-62f5a6fd9a3d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0401275 Dec 09 14:48:51.014996 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device d37591e8-0953-4fbc-9688-71f4c813e43c up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:48:51.063081 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port d37591e8-0953-4fbc-9688-71f4c813e43c triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:48:51.063427 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:51.143894 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:51.175063 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '496052b6-9737-4680-bcd6-64721946b1a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd37591e8-0953-4fbc-9688-71f4c813e43c'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:48:51.177741 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8e2c87bf-d6a7-4177-88f2-df4021014d01" -d '{"events": [{"server_uuid": "496052b6-9737-4680-bcd6-64721946b1a4", "name": "network-vif-plugged", "status": "completed", "tag": "d37591e8-0953-4fbc-9688-71f4c813e43c"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:48:51.192133 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port d37591e8-0953-4fbc-9688-71f4c813e43c, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=d37591e8-0953-4fbc-9688-71f4c813e43c,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:48:51.198737 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:51.221844 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a884e345-8159-423d-924e-3deb56dccd1b req-e3346e91-7d73-4721-98e4-0fe10821a6af tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:51.223206 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a884e345-8159-423d-924e-3deb56dccd1b req-e3346e91-7d73-4721-98e4-0fe10821a6af tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 945 time: 0.0493321 Dec 09 14:48:51.229032 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:48:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5272340a-5540-450d-9f75-227b3b6a4aa1 x-openstack-request-id: req-5272340a-5540-450d-9f75-227b3b6a4aa1 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:48:51.229327 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "496052b6-9737-4680-bcd6-64721946b1a4", "name": "network-vif-plugged", "status": "completed", "tag": "d37591e8-0953-4fbc-9688-71f4c813e43c", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:48:51.229587 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-5272340a-5540-450d-9f75-227b3b6a4aa1 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:48:51.229971 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '496052b6-9737-4680-bcd6-64721946b1a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'code': 200} Dec 09 14:48:51.255744 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=d37591e8-0953-4fbc-9688-71f4c813e43c,revision_number=7']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:51.276658 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a884e345-8159-423d-924e-3deb56dccd1b req-b5d8fbb6-2974-4218-92a8-65eb66b5e63c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471611 Dec 09 14:48:52.419466 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71626fad-13f9-4fcb-bace-ae2fe7300b15 req-f2612bae-70a2-4d04-9a80-5884162adcf7 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:52.423351 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-71626fad-13f9-4fcb-bace-ae2fe7300b15 req-f2612bae-70a2-4d04-9a80-5884162adcf7 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0669823 Dec 09 14:48:52.475989 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-71626fad-13f9-4fcb-bace-ae2fe7300b15 req-e2822388-a2aa-44bc-b96c-7e90fbb59d5b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449963 Dec 09 14:48:53.632064 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60449614-be01-4afc-b57e-e7a997575357 req-a3345b1a-4fb1-4d4b-bf00-08fe2b39afc3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:53.637443 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-60449614-be01-4afc-b57e-e7a997575357 req-a3345b1a-4fb1-4d4b-bf00-08fe2b39afc3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0615938 Dec 09 14:48:53.696029 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-60449614-be01-4afc-b57e-e7a997575357 req-046fefa0-f371-43d7-a99c-ad58f4e7b85b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0518632 Dec 09 14:48:54.843128 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bf2d063-7260-4cd1-9f50-1d9ad1e9754f req-bbaa6e87-3f78-4fda-ad81-2b305b50a908 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:54.844671 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1bf2d063-7260-4cd1-9f50-1d9ad1e9754f req-bbaa6e87-3f78-4fda-ad81-2b305b50a908 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0539744 Dec 09 14:48:54.904760 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1bf2d063-7260-4cd1-9f50-1d9ad1e9754f req-f106a124-7bcb-4ec9-a839-72cfa320c9e3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0522883 Dec 09 14:48:56.039720 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64a9b41f-dc2d-4c72-a97c-1cc27b8e8d3a req-f87f4e9f-2c1c-435d-baed-ce1deae811b9 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:56.041418 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-64a9b41f-dc2d-4c72-a97c-1cc27b8e8d3a req-f87f4e9f-2c1c-435d-baed-ce1deae811b9 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0515516 Dec 09 14:48:56.110720 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-64a9b41f-dc2d-4c72-a97c-1cc27b8e8d3a req-12b27e08-5ef8-4eee-b56e-f723fce62b00 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0631628 Dec 09 14:48:56.334703 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-53bab1ae-4544-4bbf-9580-1d1f3f746f04 req-ab3b0f14-6d99-4f03-a0d6-b56897edcc03 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-315201565&fields=id&tenant_id=ed13d07c829a42dca57ff23f7538ecda HTTP/1.1" status: 200 len: 267 time: 0.0491157 Dec 09 14:48:56.405955 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53bab1ae-4544-4bbf-9580-1d1f3f746f04 req-6b2ea1f4-14fc-459c-8f80-2c631d8b377a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:56.408200 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-53bab1ae-4544-4bbf-9580-1d1f3f746f04 req-6b2ea1f4-14fc-459c-8f80-2c631d8b377a tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 984 time: 0.0668221 Dec 09 14:48:56.420171 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [req-53bab1ae-4544-4bbf-9580-1d1f3f746f04 req-73c6e6ae-3135-4b58-b5a9-bcdb6f555f18 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Request body: {'port': {'security_groups': ['7073d18f-f08a-4238-9251-53b9b9bf0865']}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:48:56.500501 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-53bab1ae-4544-4bbf-9580-1d1f3f746f04 req-73c6e6ae-3135-4b58-b5a9-bcdb6f555f18 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:56.785499 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.db [req-53bab1ae-4544-4bbf-9580-1d1f3f746f04 req-73c6e6ae-3135-4b58-b5a9-bcdb6f555f18 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] For port 0033cc00-709a-496e-9a3b-1837dafd79dd, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0033cc00-709a-496e-9a3b-1837dafd79dd,segment=NetworkSegment(d8b4a507-9bfc-4567-82ac-77b20844733a),segment_id=d8b4a507-9bfc-4567-82ac-77b20844733a)] {{(pid=109062) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:48:56.822982 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-53bab1ae-4544-4bbf-9580-1d1f3f746f04 req-73c6e6ae-3135-4b58-b5a9-bcdb6f555f18 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:56.830135 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-53bab1ae-4544-4bbf-9580-1d1f3f746f04 req-73c6e6ae-3135-4b58-b5a9-bcdb6f555f18 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-130461426'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:56.842827 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['0033cc00-709a-496e-9a3b-1837dafd79dd'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:48:56.864348 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53bab1ae-4544-4bbf-9580-1d1f3f746f04 req-73c6e6ae-3135-4b58-b5a9-bcdb6f555f18 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:56.865643 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [req-53bab1ae-4544-4bbf-9580-1d1f3f746f04 req-73c6e6ae-3135-4b58-b5a9-bcdb6f555f18 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:56.872020 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-53bab1ae-4544-4bbf-9580-1d1f3f746f04 req-73c6e6ae-3135-4b58-b5a9-bcdb6f555f18 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "PUT /v2.0/ports/0033cc00-709a-496e-9a3b-1837dafd79dd HTTP/1.1" status: 200 len: 942 time: 0.4569232 Dec 09 14:48:56.874398 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60280) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:56.931641 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'tag': '0033cc00-709a-496e-9a3b-1837dafd79dd'}] {{(pid=109062) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:48:56.937784 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3f1ec408b0eec5a36b56e0a757eff0f4875d9a95eff62f4d0b4a62bb27a3b600" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e959e379-a9ae-4ce2-9b98-ee623de1431f" -d '{"events": [{"name": "network-changed", "server_uuid": "1556759d-80fc-4a03-accf-81a2ffccc9d1", "tag": "0033cc00-709a-496e-9a3b-1837dafd79dd"}]}' {{(pid=109062) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:48:56.989343 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['0033cc00-709a-496e-9a3b-1837dafd79dd'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:48:57.017376 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73c6e6ae-3135-4b58-b5a9-bcdb6f555f18 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Pushing event updated for resources: {'Port': ['ID=0033cc00-709a-496e-9a3b-1837dafd79dd,revision_number=7']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:57.018965 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4ccf0db6-74e0-4353-890b-d065ed3d53c1 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:57.085273 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4ccf0db6-74e0-4353-890b-d065ed3d53c1 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:57.133135 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5a7807ab-893c-4cd7-a348-a55175e17c79 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:57.231077 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4ccf0db6-74e0-4353-890b-d065ed3d53c1 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:57.234256 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4ccf0db6-74e0-4353-890b-d065ed3d53c1 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:57.235470 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-4ccf0db6-74e0-4353-890b-d065ed3d53c1 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "DELETE /v2.0/security-groups/b198c154-3d21-435b-8a30-9196034aed82 HTTP/1.1" status: 204 len: 168 time: 0.3584270 Dec 09 14:48:57.238460 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60294) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:48:57.280793 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ccf0db6-74e0-4353-890b-d065ed3d53c1 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=b198c154-3d21-435b-8a30-9196034aed82,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:57.344566 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-e02559ff-b6f4-4745-aafc-185fc74614c8 None None] Provisioning complete for port 0033cc00-709a-496e-9a3b-1837dafd79dd triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:48:57.344886 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-e02559ff-b6f4-4745-aafc-185fc74614c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:57.385987 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:48:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-898962a3-ba72-4519-be97-02907934eb1b x-openstack-request-id: req-898962a3-ba72-4519-be97-02907934eb1b {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:48:57.386407 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1556759d-80fc-4a03-accf-81a2ffccc9d1", "tag": "0033cc00-709a-496e-9a3b-1837dafd79dd", "status": "completed", "code": 200}]} {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:48:57.386740 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-898962a3-ba72-4519-be97-02907934eb1b {{(pid=109062) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:48:57.387053 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'tag': '0033cc00-709a-496e-9a3b-1837dafd79dd', 'status': 'completed', 'code': 200} Dec 09 14:48:57.389629 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e959e379-a9ae-4ce2-9b98-ee623de1431f req-564d6b6c-bf2c-432a-8abc-9f1b4694166a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:57.391642 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e959e379-a9ae-4ce2-9b98-ee623de1431f req-564d6b6c-bf2c-432a-8abc-9f1b4694166a service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=ed13d07c829a42dca57ff23f7538ecda&device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 1098 time: 0.0970411 Dec 09 14:48:57.529802 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e959e379-a9ae-4ce2-9b98-ee623de1431f req-13dd8885-9c4b-461b-87a2-a7d02109592d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:57.531596 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e959e379-a9ae-4ce2-9b98-ee623de1431f req-13dd8885-9c4b-461b-87a2-a7d02109592d service neutron] 10.222.0.44 "GET /v2.0/networks?id=ec211a40-6211-48b6-8014-deb1231b8f8a HTTP/1.1" status: 200 len: 916 time: 0.1265161 Dec 09 14:48:57.588136 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7dcbd46-1f8e-450a-bd8f-baaf7662cfed req-68ed20cd-5f39-4aee-8556-8b938505a8b0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:57.600151 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a7dcbd46-1f8e-450a-bd8f-baaf7662cfed req-68ed20cd-5f39-4aee-8556-8b938505a8b0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.2388797 Dec 09 14:48:57.686560 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a7dcbd46-1f8e-450a-bd8f-baaf7662cfed req-8e92169c-7433-4bdf-8199-d62c9eac3c87 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0847080 Dec 09 14:48:57.716259 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-85124fe7-17a0-434d-bc69-408274067866 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Deleting port e0fe9fc7-2341-413b-8242-0996736e1018 {{(pid=109062) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:48:57.716722 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-85124fe7-17a0-434d-bc69-408274067866 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:57.817698 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-85124fe7-17a0-434d-bc69-408274067866 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:57.818684 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-85124fe7-17a0-434d-bc69-408274067866 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:57.837684 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-85124fe7-17a0-434d-bc69-408274067866 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Calling delete_port for e0fe9fc7-2341-413b-8242-0996736e1018 owned by network:floatingip {{(pid=109062) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:48:58.019184 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e959e379-a9ae-4ce2-9b98-ee623de1431f req-61c7fa5b-34ba-44a2-a2b7-10781890a7b2 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=0033cc00-709a-496e-9a3b-1837dafd79dd HTTP/1.1" status: 200 len: 1001 time: 0.4761555 Dec 09 14:48:58.089551 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e959e379-a9ae-4ce2-9b98-ee623de1431f req-9452a7c5-4b00-4033-abe5-e953df69b0ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:58.092943 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e959e379-a9ae-4ce2-9b98-ee623de1431f req-9452a7c5-4b00-4033-abe5-e953df69b0ce service neutron] 10.222.0.44 "GET /v2.0/subnets?id=3e261ed3-068f-4b13-8a79-5f90048fcbe6 HTTP/1.1" status: 200 len: 854 time: 0.0631249 Dec 09 14:48:58.156650 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e959e379-a9ae-4ce2-9b98-ee623de1431f req-d97f9bdb-6aef-4225-80c5-7cb856ff93c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:58.158498 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e959e379-a9ae-4ce2-9b98-ee623de1431f req-d97f9bdb-6aef-4225-80c5-7cb856ff93c0 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=ec211a40-6211-48b6-8014-deb1231b8f8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0528400 Dec 09 14:48:58.286469 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e959e379-a9ae-4ce2-9b98-ee623de1431f req-fa66534a-ee18-4a4f-ac17-892e5dd6b860 service neutron] 10.222.0.44 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1178236 Dec 09 14:48:58.327747 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-85124fe7-17a0-434d-bc69-408274067866 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:58.362467 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85124fe7-17a0-434d-bc69-408274067866 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Pushing event deleted for resources: {'Port': ['ID=e0fe9fc7-2341-413b-8242-0996736e1018,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:48:58.404036 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e959e379-a9ae-4ce2-9b98-ee623de1431f req-046f16bd-9fa6-4963-aee8-73d31538ac01 service neutron] 10.222.0.44 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1080112 Dec 09 14:48:58.466964 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-85124fe7-17a0-434d-bc69-408274067866 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks [] for floatingip, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:58.467265 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.l3_db [None req-85124fe7-17a0-434d-bc69-408274067866 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Floating IP 5ec3442d-6600-4ea6-a436-903eca8d2dfd disassociated (deleted). External IP: 172.27.0.209, port: 0033cc00-709a-496e-9a3b-1837dafd79dd. Dec 09 14:48:58.687985 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-85124fe7-17a0-434d-bc69-408274067866 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Router 24108286-6fa2-4e97-9fab-de1871d0c79d has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:48:58.854085 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-85124fe7-17a0-434d-bc69-408274067866 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:48:58.859158 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-85124fe7-17a0-434d-bc69-408274067866 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:58.864978 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9222f819-cfaa-41c4-ac66-4ccd9a274854 None None] Sync routers for ids ['24108286-6fa2-4e97-9fab-de1871d0c79d'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:48:58.876495 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9222f819-cfaa-41c4-ac66-4ccd9a274854 None None] Routers {'24108286-6fa2-4e97-9fab-de1871d0c79d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:48:58.877145 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-9222f819-cfaa-41c4-ac66-4ccd9a274854 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:48:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['24108286-6fa2-4e97-9fab-de1871d0c79d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:48:58.908031 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc2ebab3-c313-4af6-8922-aaad1110adbf req-cb06b3c5-f75f-41bc-819a-53e3d6d0bf0c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:58.909710 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fc2ebab3-c313-4af6-8922-aaad1110adbf req-cb06b3c5-f75f-41bc-819a-53e3d6d0bf0c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.1172979 Dec 09 14:48:58.949759 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-85124fe7-17a0-434d-bc69-408274067866 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "DELETE /v2.0/floatingips/5ec3442d-6600-4ea6-a436-903eca8d2dfd HTTP/1.1" status: 204 len: 168 time: 1.7074339 Dec 09 14:48:58.986841 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fc2ebab3-c313-4af6-8922-aaad1110adbf req-708116f0-25b9-40be-aeee-ebd67061ec7d tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0663111 Dec 09 14:48:59.024530 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-9222f819-cfaa-41c4-ac66-4ccd9a274854 None None] Set router 24108286-6fa2-4e97-9fab-de1871d0c79d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:48:59.194958 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-56a6b380-f565-4f6e-af75-6c1c6f1f056d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:48:59.282755 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-9222f819-cfaa-41c4-ac66-4ccd9a274854 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:46Z', 'revision_number': 4, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'gw_port': {'id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:56:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'f8899dd4-cd7b-4334-8f00-998be8a48481', 'name': '', 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'mac_address': 'fa:16:3e:c0:25:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:46Z', 'updated_at': '2021-12-09T14:45:51Z', 'revision_number': 5, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'subnets': [{'id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:48:59.321767 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9222f819-cfaa-41c4-ac66-4ccd9a274854 None None] Checking router: 24108286-6fa2-4e97-9fab-de1871d0c79d for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:48:59.330463 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9222f819-cfaa-41c4-ac66-4ccd9a274854 None None] Routers {'24108286-6fa2-4e97-9fab-de1871d0c79d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:48:59.331075 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-9222f819-cfaa-41c4-ac66-4ccd9a274854 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:48:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['24108286-6fa2-4e97-9fab-de1871d0c79d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:48:59.388049 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'tag': '0033cc00-709a-496e-9a3b-1837dafd79dd'}] {{(pid=109062) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:48:59.390455 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3f1ec408b0eec5a36b56e0a757eff0f4875d9a95eff62f4d0b4a62bb27a3b600" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ec14177-c4ee-4028-92ec-09f4880dac5f" -d '{"events": [{"name": "network-changed", "server_uuid": "1556759d-80fc-4a03-accf-81a2ffccc9d1", "tag": "0033cc00-709a-496e-9a3b-1837dafd79dd"}]}' {{(pid=109062) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:48:59.431795 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:48:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9265d83b-8273-4d41-a040-729575ddae98 x-openstack-request-id: req-9265d83b-8273-4d41-a040-729575ddae98 {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:48:59.432444 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1556759d-80fc-4a03-accf-81a2ffccc9d1", "tag": "0033cc00-709a-496e-9a3b-1837dafd79dd", "status": "completed", "code": 200}]} {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:48:59.432911 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-9265d83b-8273-4d41-a040-729575ddae98 {{(pid=109062) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:48:59.433571 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'tag': '0033cc00-709a-496e-9a3b-1837dafd79dd', 'status': 'completed', 'code': 200} Dec 09 14:48:59.441967 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:48:59.538248 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec14177-c4ee-4028-92ec-09f4880dac5f req-f2b77190-190e-40a7-89be-dfc7c582cba4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:59.540902 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4ec14177-c4ee-4028-92ec-09f4880dac5f req-f2b77190-190e-40a7-89be-dfc7c582cba4 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=ed13d07c829a42dca57ff23f7538ecda&device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 1098 time: 0.0694439 Dec 09 14:48:59.619519 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-9222f819-cfaa-41c4-ac66-4ccd9a274854 None None] Set router 24108286-6fa2-4e97-9fab-de1871d0c79d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:48:59.656239 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec14177-c4ee-4028-92ec-09f4880dac5f req-8253bef0-125d-45c1-af2d-f889b4723e7c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:59.658050 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4ec14177-c4ee-4028-92ec-09f4880dac5f req-8253bef0-125d-45c1-af2d-f889b4723e7c service neutron] 10.222.0.44 "GET /v2.0/networks?id=ec211a40-6211-48b6-8014-deb1231b8f8a HTTP/1.1" status: 200 len: 916 time: 0.1044016 Dec 09 14:48:59.743460 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4ec14177-c4ee-4028-92ec-09f4880dac5f req-fd592d56-3aae-443e-afe4-3e67fcbca070 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=0033cc00-709a-496e-9a3b-1837dafd79dd HTTP/1.1" status: 200 len: 217 time: 0.0387950 Dec 09 14:48:59.824177 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec14177-c4ee-4028-92ec-09f4880dac5f req-bf7699ef-b6b5-427a-a83e-f542495a296e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:59.826033 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4ec14177-c4ee-4028-92ec-09f4880dac5f req-bf7699ef-b6b5-427a-a83e-f542495a296e service neutron] 10.222.0.44 "GET /v2.0/subnets?id=3e261ed3-068f-4b13-8a79-5f90048fcbe6 HTTP/1.1" status: 200 len: 854 time: 0.0703449 Dec 09 14:48:59.885653 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec14177-c4ee-4028-92ec-09f4880dac5f req-3f17c0d7-81cd-432e-871a-5ed3061e3f07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:48:59.887434 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4ec14177-c4ee-4028-92ec-09f4880dac5f req-3f17c0d7-81cd-432e-871a-5ed3061e3f07 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=ec211a40-6211-48b6-8014-deb1231b8f8a&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0505853 Dec 09 14:48:59.894691 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-9222f819-cfaa-41c4-ac66-4ccd9a274854 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:46Z', 'revision_number': 4, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'gw_port': {'id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:56:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'f8899dd4-cd7b-4334-8f00-998be8a48481', 'name': '', 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'mac_address': 'fa:16:3e:c0:25:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:46Z', 'updated_at': '2021-12-09T14:45:51Z', 'revision_number': 5, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'subnets': [{'id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:48:59.934402 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9222f819-cfaa-41c4-ac66-4ccd9a274854 None None] The sync data for ids ['24108286-6fa2-4e97-9fab-de1871d0c79d'] in dv-cinder-819692-8-iscsi is: [{'id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:46Z', 'revision_number': 4, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'gw_port': {'id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:56:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'f8899dd4-cd7b-4334-8f00-998be8a48481', 'name': '', 'network_id': 'ec211a40-6211-48b6-8014-deb1231b8f8a', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'mac_address': 'fa:16:3e:c0:25:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_interface', 'standard_attr_id': 459, 'fixed_ips': [{'subnet_id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:46Z', 'updated_at': '2021-12-09T14:45:51Z', 'revision_number': 5, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'subnets': [{'id': '3e261ed3-068f-4b13-8a79-5f90048fcbe6', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:49:00.007583 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4ec14177-c4ee-4028-92ec-09f4880dac5f req-e3d38e1b-a0ef-4a1a-8d51-67ba1cca6a1c service neutron] 10.222.0.44 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1028025 Dec 09 14:49:00.200060 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-694213e5-3e7c-4c41-a2a8-1a70ed2a9295 req-84674780-db04-4230-a5c8-fac18d325cf4 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:00.201611 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-694213e5-3e7c-4c41-a2a8-1a70ed2a9295 req-84674780-db04-4230-a5c8-fac18d325cf4 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.1159010 Dec 09 14:49:00.206355 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4ec14177-c4ee-4028-92ec-09f4880dac5f req-3e39e93d-b82e-47a4-9bcf-f10aa2d80b7b service neutron] 10.222.0.44 "GET /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1784182 Dec 09 14:49:00.355150 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1b547f30-3694-48a9-ac39-ef1f411f8c75 None None] New status for floating IP 5ec3442d-6600-4ea6-a436-903eca8d2dfd: DOWN {{(pid=109064) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:49:00.355397 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-694213e5-3e7c-4c41-a2a8-1a70ed2a9295 req-ceae3c9d-dfb7-4ff5-8a6d-0ebc6788d9a4 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1091485 Dec 09 14:49:00.458872 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:01.512726 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2975b56a-8cca-477f-a446-37d3606d80b3 req-8adddce8-68b1-4025-96ea-caec78fcc261 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:01.514237 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2975b56a-8cca-477f-a446-37d3606d80b3 req-8adddce8-68b1-4025-96ea-caec78fcc261 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0612926 Dec 09 14:49:01.569881 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2975b56a-8cca-477f-a446-37d3606d80b3 req-e13783e1-c4d5-4ac2-a593-3e924c9173bd tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492067 Dec 09 14:49:01.817763 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:01.849602 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-436a34b8-a8d8-44d1-a628-af23fd290258 req-b12b1903-fa0d-419b-a0f3-ae7a0967a22f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:01.851780 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-436a34b8-a8d8-44d1-a628-af23fd290258 req-b12b1903-fa0d-419b-a0f3-ae7a0967a22f service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=6be5d78d2d0049448c3947b4e650758a&device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 1099 time: 0.0452456 Dec 09 14:49:01.971577 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df05143e-3ab4-4bc3-90c0-174ba677b965 req-7a7c9bcb-758b-4520-b494-e36b4b045bf8 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:01.973110 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-df05143e-3ab4-4bc3-90c0-174ba677b965 req-7a7c9bcb-758b-4520-b494-e36b4b045bf8 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 945 time: 0.1040378 Dec 09 14:49:02.005859 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-436a34b8-a8d8-44d1-a628-af23fd290258 req-0a0b1cd3-ad18-4756-aa1a-c663c10cdb09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:02.007435 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-436a34b8-a8d8-44d1-a628-af23fd290258 req-0a0b1cd3-ad18-4756-aa1a-c663c10cdb09 service neutron] 10.222.0.44 "GET /v2.0/networks?id=9ab3f8b6-44d0-4210-907d-0e96072c4566 HTTP/1.1" status: 200 len: 917 time: 0.1464279 Dec 09 14:49:02.077469 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-df05143e-3ab4-4bc3-90c0-174ba677b965 req-28858f4d-d419-4688-a97c-54fd0aded715 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0979643 Dec 09 14:49:02.099795 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-436a34b8-a8d8-44d1-a628-af23fd290258 req-e7967ad4-06ae-4563-8ed6-8aca5a40da2e service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d37591e8-0953-4fbc-9688-71f4c813e43c HTTP/1.1" status: 200 len: 1002 time: 0.0786405 Dec 09 14:49:02.153877 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-436a34b8-a8d8-44d1-a628-af23fd290258 req-f6139b09-44a5-4b1b-9c15-a7a20f557c94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:02.155303 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-436a34b8-a8d8-44d1-a628-af23fd290258 req-f6139b09-44a5-4b1b-9c15-a7a20f557c94 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=f10f1097-5d43-4737-bcac-a27ade66b442 HTTP/1.1" status: 200 len: 855 time: 0.0463688 Dec 09 14:49:02.205817 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-436a34b8-a8d8-44d1-a628-af23fd290258 req-74bc3a35-6e80-4551-a13a-60c15ffa58ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:02.207417 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-436a34b8-a8d8-44d1-a628-af23fd290258 req-74bc3a35-6e80-4551-a13a-60c15ffa58ac service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=9ab3f8b6-44d0-4210-907d-0e96072c4566&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0429721 Dec 09 14:49:02.316039 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-436a34b8-a8d8-44d1-a628-af23fd290258 req-7de434db-405a-4376-921b-0fead2b3bfb4 service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0973406 Dec 09 14:49:02.410268 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-436a34b8-a8d8-44d1-a628-af23fd290258 req-43239429-7a94-46a8-ac75-050cb03d7560 service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0852010 Dec 09 14:49:02.621214 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:02.703667 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39cbe7ef-7db0-4891-9890-bd14b4855c42 req-efa124b5-e5b9-4548-bf24-fb4fbe4eede7 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:02.705136 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-39cbe7ef-7db0-4891-9890-bd14b4855c42 req-efa124b5-e5b9-4548-bf24-fb4fbe4eede7 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0492191 Dec 09 14:49:02.752847 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-39cbe7ef-7db0-4891-9890-bd14b4855c42 req-01978407-cb2d-4bb2-9084-2900a347e93a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417097 Dec 09 14:49:03.206830 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b078fd04-caf5-4f85-a2a4-463f308a44b8 req-fb11525b-67b5-420b-85be-9d312df92dcb tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:03.208524 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b078fd04-caf5-4f85-a2a4-463f308a44b8 req-fb11525b-67b5-420b-85be-9d312df92dcb tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 945 time: 0.0555663 Dec 09 14:49:03.257101 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b078fd04-caf5-4f85-a2a4-463f308a44b8 req-b851daa1-6b6c-4988-b184-4129ee7f3358 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423527 Dec 09 14:49:03.891404 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cda9791-a810-45d1-a2f1-34ee8ab11320 req-fd8fd02b-b4dd-47ea-88ac-0dd2460a428e tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:03.892895 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0cda9791-a810-45d1-a2f1-34ee8ab11320 req-fd8fd02b-b4dd-47ea-88ac-0dd2460a428e tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0553129 Dec 09 14:49:03.944890 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0cda9791-a810-45d1-a2f1-34ee8ab11320 req-b6078d82-137b-4e2f-81c2-02935a25b9db tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458648 Dec 09 14:49:04.109151 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bace94d2-a863-4135-b962-70556801367c req-781fe231-5b36-4bda-90a6-d5396ea0a955 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:04.110653 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bace94d2-a863-4135-b962-70556801367c req-781fe231-5b36-4bda-90a6-d5396ea0a955 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.44 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 945 time: 0.0541310 Dec 09 14:49:04.208555 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-bace94d2-a863-4135-b962-70556801367c req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Deleting port 0033cc00-709a-496e-9a3b-1837dafd79dd {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:04.208901 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-bace94d2-a863-4135-b962-70556801367c req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:04.303589 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-bace94d2-a863-4135-b962-70556801367c req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] For port 0033cc00-709a-496e-9a3b-1837dafd79dd, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0033cc00-709a-496e-9a3b-1837dafd79dd,segment=NetworkSegment(d8b4a507-9bfc-4567-82ac-77b20844733a),segment_id=d8b4a507-9bfc-4567-82ac-77b20844733a)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:04.303990 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-bace94d2-a863-4135-b962-70556801367c req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:04.317214 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-bace94d2-a863-4135-b962-70556801367c req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Calling delete_port for 0033cc00-709a-496e-9a3b-1837dafd79dd owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:04.421108 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4495dab4-1512-4a3e-a27b-c09304c01242 req-f3292c67-2032-4825-8100-984fa3c0335f tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:04.422594 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4495dab4-1512-4a3e-a27b-c09304c01242 req-f3292c67-2032-4825-8100-984fa3c0335f tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/ports?device_id=1556759d-80fc-4a03-accf-81a2ffccc9d1 HTTP/1.1" status: 200 len: 945 time: 0.0969644 Dec 09 14:49:04.502935 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4495dab4-1512-4a3e-a27b-c09304c01242 req-32f2abfc-670b-4f72-88e7-2372feb945bb tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.39 "GET /v2.0/security-groups?id=7073d18f-f08a-4238-9251-53b9b9bf0865&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700874 Dec 09 14:49:04.523563 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-bace94d2-a863-4135-b962-70556801367c req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:04.535724 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['0033cc00-709a-496e-9a3b-1837dafd79dd'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:49:04.554267 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Pushing event deleted for resources: {'Port': ['ID=0033cc00-709a-496e-9a3b-1837dafd79dd,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:04.567312 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:04.567721 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:04.568077 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:04.568424 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:04.568819 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:04.569160 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:04.569495 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:04.569863 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:04.570196 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:04.570527 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:04.570831 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:04.571189 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:04.571486 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:04.608647 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-bace94d2-a863-4135-b962-70556801367c req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] No DVR routers for this DVR port 0033cc00-709a-496e-9a3b-1837dafd79dd on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:49:04.611363 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-bace94d2-a863-4135-b962-70556801367c req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:04.614900 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bace94d2-a863-4135-b962-70556801367c req-b7dba563-a16b-4286-baae-baa399864258 tempest-TestMinimumBasicScenario-2114138686 tempest-TestMinimumBasicScenario-2114138686-project] 10.222.0.44 "DELETE /v2.0/ports/0033cc00-709a-496e-9a3b-1837dafd79dd HTTP/1.1" status: 204 len: 173 time: 0.4972415 Dec 09 14:49:04.615350 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'name': 'network-vif-deleted', 'tag': '0033cc00-709a-496e-9a3b-1837dafd79dd'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:49:04.617798 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-257f9ae7-5b13-4616-b066-170ea120b134" -d '{"events": [{"server_uuid": "1556759d-80fc-4a03-accf-81a2ffccc9d1", "name": "network-vif-deleted", "tag": "0033cc00-709a-496e-9a3b-1837dafd79dd"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:49:04.656714 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:49:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b1cbb34f-4037-4f2e-9aac-a1715e987f1e x-openstack-request-id: req-b1cbb34f-4037-4f2e-9aac-a1715e987f1e {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:49:04.657080 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1556759d-80fc-4a03-accf-81a2ffccc9d1", "name": "network-vif-deleted", "tag": "0033cc00-709a-496e-9a3b-1837dafd79dd", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:49:04.657405 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-b1cbb34f-4037-4f2e-9aac-a1715e987f1e {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:49:04.657813 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1556759d-80fc-4a03-accf-81a2ffccc9d1', 'name': 'network-vif-deleted', 'tag': '0033cc00-709a-496e-9a3b-1837dafd79dd', 'status': 'completed', 'code': 200} Dec 09 14:49:05.071052 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-232420d3-03b5-4bb8-a6a6-d53437f64ddd req-9402ff6b-1d49-4201-b5b7-b763a650212f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:05.072628 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-232420d3-03b5-4bb8-a6a6-d53437f64ddd req-9402ff6b-1d49-4201-b5b7-b763a650212f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 946 time: 0.0536823 Dec 09 14:49:05.106705 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device d37591e8-0953-4fbc-9688-71f4c813e43c no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:49:05.121270 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-232420d3-03b5-4bb8-a6a6-d53437f64ddd req-688ef1ff-e878-4e61-80ac-3694087fd0a1 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424218 Dec 09 14:49:05.197146 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:05.222113 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '496052b6-9737-4680-bcd6-64721946b1a4', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'd37591e8-0953-4fbc-9688-71f4c813e43c'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:49:05.224734 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f00abe89-31dd-4794-9d22-35214052c394" -d '{"events": [{"server_uuid": "496052b6-9737-4680-bcd6-64721946b1a4", "name": "network-vif-unplugged", "status": "completed", "tag": "d37591e8-0953-4fbc-9688-71f4c813e43c"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:49:05.239542 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port d37591e8-0953-4fbc-9688-71f4c813e43c, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=d37591e8-0953-4fbc-9688-71f4c813e43c,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:05.246238 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:05.247357 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 0033cc00-709a-496e-9a3b-1837dafd79dd no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:49:05.269931 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: 0033cc00-709a-496e-9a3b-1837dafd79dd {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:49:05.270235 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 0033cc00-709a-496e-9a3b-1837dafd79dd not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:49:05.273753 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Thu, 09 Dec 2021 14:49:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a5240b10-1ff2-41ab-bac6-db95782c8cb6 x-openstack-request-id: req-a5240b10-1ff2-41ab-bac6-db95782c8cb6 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:49:05.274350 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "496052b6-9737-4680-bcd6-64721946b1a4", "name": "network-vif-unplugged", "status": "failed", "tag": "d37591e8-0953-4fbc-9688-71f4c813e43c", "code": 422}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:49:05.274775 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-a5240b10-1ff2-41ab-bac6-db95782c8cb6 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:49:05.275290 dv-cinder-819692-8-iscsi neutron-server[109063]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '496052b6-9737-4680-bcd6-64721946b1a4', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'code': 422} returned with failed status Dec 09 14:49:05.329827 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=d37591e8-0953-4fbc-9688-71f4c813e43c,revision_number=8']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:06.069368 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60480) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:06.110781 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-720f582e-7a71-4e4a-bdf1-afeca2852448 req-6bc4af21-9564-4535-8b36-b41238c06322 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:06.112325 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-720f582e-7a71-4e4a-bdf1-afeca2852448 req-6bc4af21-9564-4535-8b36-b41238c06322 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0502472 Dec 09 14:49:06.189170 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-720f582e-7a71-4e4a-bdf1-afeca2852448 req-ffee7e5c-b119-4475-9c28-cf13a33bca94 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0681214 Dec 09 14:49:06.192810 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-4da77ea0-b673-456e-b6ba-3233dddc03e5 req-a3f9b200-ba00-4fe4-b829-9e733c0da01d service neutron] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0645525 Dec 09 14:49:06.493869 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f16384fe-24a7-4d3d-a74a-63c5e5e7f806 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1629277'] for router_interface, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:06.807392 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-f16384fe-24a7-4d3d-a74a-63c5e5e7f806 admin admin] Deleting port f8899dd4-cd7b-4334-8f00-998be8a48481 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:06.807744 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f16384fe-24a7-4d3d-a74a-63c5e5e7f806 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:06.894059 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-f16384fe-24a7-4d3d-a74a-63c5e5e7f806 admin admin] For port f8899dd4-cd7b-4334-8f00-998be8a48481, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=f8899dd4-cd7b-4334-8f00-998be8a48481,segment=NetworkSegment(d8b4a507-9bfc-4567-82ac-77b20844733a),segment_id=d8b4a507-9bfc-4567-82ac-77b20844733a)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:06.894487 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f16384fe-24a7-4d3d-a74a-63c5e5e7f806 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:06.908689 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-f16384fe-24a7-4d3d-a74a-63c5e5e7f806 admin admin] Calling delete_port for f8899dd4-cd7b-4334-8f00-998be8a48481 owned by network:router_interface {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:07.087919 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f16384fe-24a7-4d3d-a74a-63c5e5e7f806 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:07.127041 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f16384fe-24a7-4d3d-a74a-63c5e5e7f806 admin admin] Pushing event deleted for resources: {'Port': ['ID=f8899dd4-cd7b-4334-8f00-998be8a48481,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:07.301331 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-f16384fe-24a7-4d3d-a74a-63c5e5e7f806 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2066028', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1629233'] for router_interface, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:07.316929 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a889a53-61b9-4f22-9437-380fc8c97fad req-0ba8f07b-1ae0-4666-b58b-d5731e949b16 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:07.318429 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-9a889a53-61b9-4f22-9437-380fc8c97fad req-0ba8f07b-1ae0-4666-b58b-d5731e949b16 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0529301 Dec 09 14:49:07.367932 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-9a889a53-61b9-4f22-9437-380fc8c97fad req-8b60a573-90c1-4cd6-bb68-95cc68ca8ef7 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431397 Dec 09 14:49:07.520922 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f16384fe-24a7-4d3d-a74a-63c5e5e7f806 admin admin] Router 24108286-6fa2-4e97-9fab-de1871d0c79d has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:49:07.882700 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f16384fe-24a7-4d3d-a74a-63c5e5e7f806 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:49:07.890840 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-f16384fe-24a7-4d3d-a74a-63c5e5e7f806 admin admin] 10.222.0.39 "PUT /v2.0/routers/24108286-6fa2-4e97-9fab-de1871d0c79d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8177552 Dec 09 14:49:07.891109 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60506) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:07.892228 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-745e9c5d-2d6e-4c68-8b79-dac0fbf04632 None None] Sync routers for ids ['24108286-6fa2-4e97-9fab-de1871d0c79d'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:49:07.906342 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-745e9c5d-2d6e-4c68-8b79-dac0fbf04632 None None] Routers {'24108286-6fa2-4e97-9fab-de1871d0c79d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:49:07.906970 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-745e9c5d-2d6e-4c68-8b79-dac0fbf04632 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:48:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['24108286-6fa2-4e97-9fab-de1871d0c79d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:07.995316 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] Publish callbacks [] for router, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:08.013015 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-745e9c5d-2d6e-4c68-8b79-dac0fbf04632 None None] Set router 24108286-6fa2-4e97-9fab-de1871d0c79d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:49:08.094873 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:08.151425 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] Deleting port 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:08.151801 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:08.188582 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-745e9c5d-2d6e-4c68-8b79-dac0fbf04632 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214'}], 'enable_snat': True}, 'gw_port_id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:49:07Z', 'revision_number': 5, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'gw_port': {'id': '8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:e7:56:42', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 458, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.214', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:45:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:08.214578 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-745e9c5d-2d6e-4c68-8b79-dac0fbf04632 None None] Checking router: 24108286-6fa2-4e97-9fab-de1871d0c79d for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:49:08.222869 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-745e9c5d-2d6e-4c68-8b79-dac0fbf04632 None None] Routers {'24108286-6fa2-4e97-9fab-de1871d0c79d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:49:08.223475 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-745e9c5d-2d6e-4c68-8b79-dac0fbf04632 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:48:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['24108286-6fa2-4e97-9fab-de1871d0c79d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:08.228629 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] For port 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:08.229035 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:08.241444 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] Calling delete_port for 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e owned by network:router_gateway {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:08.309077 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-745e9c5d-2d6e-4c68-8b79-dac0fbf04632 None None] Set router 24108286-6fa2-4e97-9fab-de1871d0c79d gateway port host: None {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:49:08.361298 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-745e9c5d-2d6e-4c68-8b79-dac0fbf04632 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:49:08Z', 'revision_number': 6, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'gw_port_host': None}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:08.388324 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-745e9c5d-2d6e-4c68-8b79-dac0fbf04632 None None] The sync data for ids ['24108286-6fa2-4e97-9fab-de1871d0c79d'] in dv-cinder-819692-8-iscsi is: [{'id': '24108286-6fa2-4e97-9fab-de1871d0c79d', 'name': 'tempest-TestMinimumBasicScenario-1921566986-router', 'tenant_id': 'ed13d07c829a42dca57ff23f7538ecda', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:44Z', 'updated_at': '2021-12-09T14:49:08Z', 'revision_number': 6, 'project_id': 'ed13d07c829a42dca57ff23f7538ecda', 'gw_port_host': None}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:49:08.407276 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:08.439060 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] Pushing event deleted for resources: {'Port': ['ID=8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:08.499727 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2bbd18d9-a9f2-4e9b-89be-9f5d4ba60978 req-b3118cda-9d08-458b-a3ec-fb0cf4f63603 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:08.501351 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2bbd18d9-a9f2-4e9b-89be-9f5d4ba60978 req-b3118cda-9d08-458b-a3ec-fb0cf4f63603 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0501368 Dec 09 14:49:08.501857 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1574291'] for router_gateway, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:08.548637 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2bbd18d9-a9f2-4e9b-89be-9f5d4ba60978 req-28d84068-c2f3-4363-9611-2c9ab2c83590 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408142 Dec 09 14:49:08.591759 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1626627', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30560'] for router, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:08.593947 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:08.640042 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1626682'] for router, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:08.640751 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 24108286-6fa2-4e97-9fab-de1871d0c79d {{(pid=109061) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 14:49:08.646164 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:08.647576 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-21862213-696c-4ec2-87c5-572cddb99f65 admin admin] 10.222.0.39 "DELETE /v2.0/routers/24108286-6fa2-4e97-9fab-de1871d0c79d HTTP/1.1" status: 204 len: 168 time: 0.7554839 Dec 09 14:49:08.650227 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60510) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:08.704382 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_v2 [None req-c57b99d0-f867-49f3-b07b-168b254c77da admin admin] Deleting subnet 3e261ed3-068f-4b13-8a79-5f90048fcbe6 {{(pid=109061) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:49:08.708192 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c57b99d0-f867-49f3-b07b-168b254c77da admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:08.744353 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c57b99d0-f867-49f3-b07b-168b254c77da admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1271942'] for subnet, precommit_delete_associations {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:08.857540 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c57b99d0-f867-49f3-b07b-168b254c77da admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:08.916682 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c57b99d0-f867-49f3-b07b-168b254c77da admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-133412315', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-133640812'] for subnet, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:08.942173 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c57b99d0-f867-49f3-b07b-168b254c77da admin admin] Pushing event deleted for resources: {'Subnet': ['ID=3e261ed3-068f-4b13-8a79-5f90048fcbe6,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:08.945880 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c57b99d0-f867-49f3-b07b-168b254c77da admin admin] Publish callbacks [] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:08.950904 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-c57b99d0-f867-49f3-b07b-168b254c77da admin admin] 10.222.0.39 "DELETE /v2.0/subnets/3e261ed3-068f-4b13-8a79-5f90048fcbe6 HTTP/1.1" status: 204 len: 168 time: 0.2979620 Dec 09 14:49:08.951763 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60514) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:08.954365 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f4ab720-44e9-4f7b-84bd-da45959c9f15 None None] Network ec211a40-6211-48b6-8014-deb1231b8f8a requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:49:09.019209 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:09.077588 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] Deleting port 5fb2858f-6ecf-4a2f-986f-7725989d9d69 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:09.077931 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:09.145572 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] For port 5fb2858f-6ecf-4a2f-986f-7725989d9d69, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=5fb2858f-6ecf-4a2f-986f-7725989d9d69,segment=NetworkSegment(d8b4a507-9bfc-4567-82ac-77b20844733a),segment_id=d8b4a507-9bfc-4567-82ac-77b20844733a)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:09.146167 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:09.147418 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1086f86a-ae33-4ad1-baea-fd71a8cb18b8 None None] DHCP port deletion for ec211a40-6211-48b6-8014-deb1231b8f8a request from dv-cinder-819692-8-iscsi {{(pid=109063) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 14:49:09.164437 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] Calling delete_port for 5fb2858f-6ecf-4a2f-986f-7725989d9d69 owned by network:dhcp {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:09.197482 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-1086f86a-ae33-4ad1-baea-fd71a8cb18b8 None None] Deleting port 5fb2858f-6ecf-4a2f-986f-7725989d9d69 {{(pid=109063) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:09.197871 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-1086f86a-ae33-4ad1-baea-fd71a8cb18b8 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:09.239345 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:49:09.262420 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:09.273148 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:49:09.273594 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 8948c89c-66ab-4ec7-8fcb-a1d0fe6c720e not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:49:09.274025 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 5fb2858f-6ecf-4a2f-986f-7725989d9d69 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:49:09.290075 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] Pushing event deleted for resources: {'Port': ['ID=5fb2858f-6ecf-4a2f-986f-7725989d9d69,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:09.293865 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] No DVR routers for this DVR port 5fb2858f-6ecf-4a2f-986f-7725989d9d69 on host dv-cinder-819692-8-iscsi {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:49:09.304245 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 5fb2858f-6ecf-4a2f-986f-7725989d9d69 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:49:09.304618 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 5fb2858f-6ecf-4a2f-986f-7725989d9d69 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:49:09.305044 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device f8899dd4-cd7b-4334-8f00-998be8a48481 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:49:09.311468 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-1086f86a-ae33-4ad1-baea-fd71a8cb18b8 None None] For port 5fb2858f-6ecf-4a2f-986f-7725989d9d69, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=5fb2858f-6ecf-4a2f-986f-7725989d9d69,segment=NetworkSegment(d8b4a507-9bfc-4567-82ac-77b20844733a),segment_id=d8b4a507-9bfc-4567-82ac-77b20844733a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:09.311896 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-1086f86a-ae33-4ad1-baea-fd71a8cb18b8 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:09.333420 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: f8899dd4-cd7b-4334-8f00-998be8a48481 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:49:09.333688 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device f8899dd4-cd7b-4334-8f00-998be8a48481 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:49:09.342033 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-1086f86a-ae33-4ad1-baea-fd71a8cb18b8 None None] Calling delete_port for 5fb2858f-6ecf-4a2f-986f-7725989d9d69 owned by network:dhcp {{(pid=109063) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:09.367210 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:09.392639 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ec211a40-6211-48b6-8014-deb1231b8f8a']}} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:09.404123 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd8b4a507-9bfc-4567-82ac-77b20844733a') {'for_net_delete': True} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:09.404477 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd8b4a507-9bfc-4567-82ac-77b20844733a') {} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:09.414492 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1271949'] for segment, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:09.430183 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:09.437583 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] Releasing vlan 426 on physical network physnet1 to pool {{(pid=109061) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:49:09.438057 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-133412129'] for segment, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: Traceback (most recent call last): Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: timer() Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: cb(*args, **kw) Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: return func(*args, **kwargs) Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: self._notify() Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: self.callback(batched_events) Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: event.method(event) Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: return f(self, *a, **k) Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._get(url).json() Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: return self.request(url, 'GET', **kwargs) Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:49:09.440043 dv-cinder-819692-8-iscsi neutron-server[109061]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:49:09.462767 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-1086f86a-ae33-4ad1-baea-fd71a8cb18b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959'] for port, after_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:09.487352 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1086f86a-ae33-4ad1-baea-fd71a8cb18b8 None None] Pushing event deleted for resources: {'Port': ['ID=5fb2858f-6ecf-4a2f-986f-7725989d9d69,revision_number=None']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:09.492048 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1086f86a-ae33-4ad1-baea-fd71a8cb18b8 None None] No DVR routers for this DVR port 5fb2858f-6ecf-4a2f-986f-7725989d9d69 on host dv-cinder-819692-8-iscsi {{(pid=109063) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:49:09.503300 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:09.509025 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:09.512317 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] 10.222.0.39 "DELETE /v2.0/networks/ec211a40-6211-48b6-8014-deb1231b8f8a HTTP/1.1" status: 204 len: 168 time: 0.5596440 Dec 09 14:49:09.517458 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60516) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:09.562548 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50b0c648-e419-4f2c-99eb-f1137135fb35 admin admin] Pushing event deleted for resources: {'Network': ['ID=ec211a40-6211-48b6-8014-deb1231b8f8a,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:09.672786 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c05951f1-bae6-4de8-8bc6-7e3dd9672a33 req-702d08a4-cb6b-4845-9955-cc6c927447f4 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:09.674232 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c05951f1-bae6-4de8-8bc6-7e3dd9672a33 req-702d08a4-cb6b-4845-9955-cc6c927447f4 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0522392 Dec 09 14:49:09.725109 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c05951f1-bae6-4de8-8bc6-7e3dd9672a33 req-5770e180-b981-4c19-83cc-43eaa0ed3401 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446432 Dec 09 14:49:09.877347 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e7fffb85-5f09-4565-85fb-a0371f104895 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1629277'] for router_interface, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:10.062484 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da77ea0-b673-456e-b6ba-3233dddc03e5 req-0fe82757-d002-4176-9f35-1cd82a0b27f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:10.064061 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4da77ea0-b673-456e-b6ba-3233dddc03e5 req-0fe82757-d002-4176-9f35-1cd82a0b27f8 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4&tenant_id=6be5d78d2d0049448c3947b4e650758a HTTP/1.1" status: 200 len: 1097 time: 0.0977998 Dec 09 14:49:10.166908 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da77ea0-b673-456e-b6ba-3233dddc03e5 req-8b2c7fea-3df3-4ac2-8332-ece8b119b872 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:10.168326 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4da77ea0-b673-456e-b6ba-3233dddc03e5 req-8b2c7fea-3df3-4ac2-8332-ece8b119b872 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=6be5d78d2d0049448c3947b4e650758a&device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 1097 time: 0.0784793 Dec 09 14:49:10.242151 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-e7fffb85-5f09-4565-85fb-a0371f104895 admin admin] Deleting port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:10.242484 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e7fffb85-5f09-4565-85fb-a0371f104895 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:10.315283 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da77ea0-b673-456e-b6ba-3233dddc03e5 req-f002d169-ada8-4abe-b0f3-7010bc8a6a24 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:10.316793 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4da77ea0-b673-456e-b6ba-3233dddc03e5 req-f002d169-ada8-4abe-b0f3-7010bc8a6a24 service neutron] 10.222.0.44 "GET /v2.0/networks?id=9ab3f8b6-44d0-4210-907d-0e96072c4566 HTTP/1.1" status: 200 len: 917 time: 0.1353736 Dec 09 14:49:10.381462 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-e7fffb85-5f09-4565-85fb-a0371f104895 admin admin] For port 0893b89a-a8f4-46d8-8199-f1d43ad13d5e, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=0893b89a-a8f4-46d8-8199-f1d43ad13d5e,segment=NetworkSegment(88bbc0ad-3992-4920-a16f-cea3a608ea88),segment_id=88bbc0ad-3992-4920-a16f-cea3a608ea88)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:10.381853 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e7fffb85-5f09-4565-85fb-a0371f104895 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:10.399377 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-e7fffb85-5f09-4565-85fb-a0371f104895 admin admin] Calling delete_port for 0893b89a-a8f4-46d8-8199-f1d43ad13d5e owned by network:router_interface {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:10.416650 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4da77ea0-b673-456e-b6ba-3233dddc03e5 req-092963b0-0032-4bc4-aae1-e02a50138714 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d37591e8-0953-4fbc-9688-71f4c813e43c HTTP/1.1" status: 200 len: 1000 time: 0.0904253 Dec 09 14:49:10.505574 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da77ea0-b673-456e-b6ba-3233dddc03e5 req-6469e48d-0c90-4e5b-9c2e-ed932d839a83 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:10.507020 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4da77ea0-b673-456e-b6ba-3233dddc03e5 req-6469e48d-0c90-4e5b-9c2e-ed932d839a83 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=f10f1097-5d43-4737-bcac-a27ade66b442 HTTP/1.1" status: 200 len: 855 time: 0.0604849 Dec 09 14:49:10.602603 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4da77ea0-b673-456e-b6ba-3233dddc03e5 req-a84f7e5d-312a-4a3e-9209-72a5a76032f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:10.604217 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4da77ea0-b673-456e-b6ba-3233dddc03e5 req-a84f7e5d-312a-4a3e-9209-72a5a76032f6 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=9ab3f8b6-44d0-4210-907d-0e96072c4566&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0608268 Dec 09 14:49:10.704413 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e7fffb85-5f09-4565-85fb-a0371f104895 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:10.743988 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7fffb85-5f09-4565-85fb-a0371f104895 admin admin] Pushing event deleted for resources: {'Port': ['ID=0893b89a-a8f4-46d8-8199-f1d43ad13d5e,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:10.816578 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4da77ea0-b673-456e-b6ba-3233dddc03e5 req-a46e368a-e858-41f3-ad1f-589f58b06c71 service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2014585 Dec 09 14:49:10.871395 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f8845aa-fe6a-4904-8326-2275351e6d9e req-4c0efff6-47ea-4d9b-9e44-540726aaccf5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:10.873706 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0f8845aa-fe6a-4904-8326-2275351e6d9e req-4c0efff6-47ea-4d9b-9e44-540726aaccf5 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0624335 Dec 09 14:49:10.934360 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0f8845aa-fe6a-4904-8326-2275351e6d9e req-db1f6c79-d5cd-4db8-bfeb-9c59f028c4dc tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0540202 Dec 09 14:49:11.007713 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4da77ea0-b673-456e-b6ba-3233dddc03e5 req-61fec998-1ae9-42ab-902a-1d41f114f7da service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1816726 Dec 09 14:49:11.030656 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e7fffb85-5f09-4565-85fb-a0371f104895 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2066028', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1629233'] for router_interface, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:11.565841 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e7fffb85-5f09-4565-85fb-a0371f104895 admin admin] Router fac36cef-4c08-4e2d-859e-cc78861e8157 has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:49:11.683691 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e7fffb85-5f09-4565-85fb-a0371f104895 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:49:11.698108 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-e7fffb85-5f09-4565-85fb-a0371f104895 admin admin] 10.222.0.39 "PUT /v2.0/routers/fac36cef-4c08-4e2d-859e-cc78861e8157/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1784334 Dec 09 14:49:11.698108 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60552) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:11.700332 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4340df43-13e9-4818-a32a-822ca18f3fc8 None None] Sync routers for ids ['fac36cef-4c08-4e2d-859e-cc78861e8157'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:49:11.722063 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4340df43-13e9-4818-a32a-822ca18f3fc8 None None] Routers {'fac36cef-4c08-4e2d-859e-cc78861e8157'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:49:11.722910 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-4340df43-13e9-4818-a32a-822ca18f3fc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:48:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['fac36cef-4c08-4e2d-859e-cc78861e8157'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:11.832943 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-4340df43-13e9-4818-a32a-822ca18f3fc8 None None] Set router fac36cef-4c08-4e2d-859e-cc78861e8157 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:49:11.841090 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] Publish callbacks [] for router, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:11.954062 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:12.038007 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] Deleting port 7b23c792-8975-498e-95fb-ead891ed2cec {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:12.038767 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:12.070877 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-4340df43-13e9-4818-a32a-822ca18f3fc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'name': 'tempest-TestMinimumBasicScenario-1608639764-router', 'tenant_id': 'aa21c3a67db0467f939fcab87f0358ac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.181'}], 'enable_snat': True}, 'gw_port_id': '7b23c792-8975-498e-95fb-ead891ed2cec', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:49:10Z', 'revision_number': 5, 'project_id': 'aa21c3a67db0467f939fcab87f0358ac', 'gw_port': {'id': '7b23c792-8975-498e-95fb-ead891ed2cec', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:d5:6f:cd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'device_owner': 'network:router_gateway', 'standard_attr_id': 470, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.181', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:45:53Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:12.135697 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4340df43-13e9-4818-a32a-822ca18f3fc8 None None] Checking router: fac36cef-4c08-4e2d-859e-cc78861e8157 for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:49:12.150187 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48d1cc3e-fb85-481c-883e-6cd1abe3c299 req-d1d81cae-1e10-4a24-a30a-0295f51a3b61 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:12.152747 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-48d1cc3e-fb85-481c-883e-6cd1abe3c299 req-d1d81cae-1e10-4a24-a30a-0295f51a3b61 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0677710 Dec 09 14:49:12.164158 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4340df43-13e9-4818-a32a-822ca18f3fc8 None None] Routers {'fac36cef-4c08-4e2d-859e-cc78861e8157'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:49:12.164825 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-4340df43-13e9-4818-a32a-822ca18f3fc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 4, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:48:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['fac36cef-4c08-4e2d-859e-cc78861e8157'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:12.197266 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] For port 7b23c792-8975-498e-95fb-ead891ed2cec, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=7b23c792-8975-498e-95fb-ead891ed2cec,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:12.197626 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:12.220329 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-48d1cc3e-fb85-481c-883e-6cd1abe3c299 req-18ba465d-736e-477c-84d1-0b54ddc30276 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0614216 Dec 09 14:49:12.237084 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] Calling delete_port for 7b23c792-8975-498e-95fb-ead891ed2cec owned by network:router_gateway {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:12.295133 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-4340df43-13e9-4818-a32a-822ca18f3fc8 None None] Set router fac36cef-4c08-4e2d-859e-cc78861e8157 gateway port host: None {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:49:12.357872 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-4340df43-13e9-4818-a32a-822ca18f3fc8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'name': 'tempest-TestMinimumBasicScenario-1608639764-router', 'tenant_id': 'aa21c3a67db0467f939fcab87f0358ac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:49:11Z', 'revision_number': 6, 'project_id': 'aa21c3a67db0467f939fcab87f0358ac', 'gw_port_host': None}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:12.441086 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:12.471025 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] Pushing event deleted for resources: {'Port': ['ID=7b23c792-8975-498e-95fb-ead891ed2cec,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:12.482559 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4340df43-13e9-4818-a32a-822ca18f3fc8 None None] The sync data for ids ['fac36cef-4c08-4e2d-859e-cc78861e8157'] in dv-cinder-819692-8-iscsi is: [{'id': 'fac36cef-4c08-4e2d-859e-cc78861e8157', 'name': 'tempest-TestMinimumBasicScenario-1608639764-router', 'tenant_id': 'aa21c3a67db0467f939fcab87f0358ac', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:45:49Z', 'updated_at': '2021-12-09T14:49:11Z', 'revision_number': 6, 'project_id': 'aa21c3a67db0467f939fcab87f0358ac', 'gw_port_host': None}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:49:12.548473 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1574291'] for router_gateway, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:12.640789 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1626627', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30560'] for router, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:12.642892 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:12.693571 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1626682'] for router, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:12.694197 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] Fanout notify agent at l3_agent the message router_deleted on router fac36cef-4c08-4e2d-859e-cc78861e8157 {{(pid=109061) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 14:49:12.699346 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:12.700564 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-cad58274-8f81-4039-b109-bcbe00d6749e admin admin] 10.222.0.39 "DELETE /v2.0/routers/fac36cef-4c08-4e2d-859e-cc78861e8157 HTTP/1.1" status: 204 len: 168 time: 1.0002372 Dec 09 14:49:12.703093 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60566) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:12.754179 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_v2 [None req-ae3dc264-216d-4ea7-a094-6d4e4aa1d88b admin admin] Deleting subnet b521ad48-f786-4d81-985a-213254001050 {{(pid=109061) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:49:12.757505 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ae3dc264-216d-4ea7-a094-6d4e4aa1d88b admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:12.793099 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ae3dc264-216d-4ea7-a094-6d4e4aa1d88b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1271942'] for subnet, precommit_delete_associations {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:12.885448 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ae3dc264-216d-4ea7-a094-6d4e4aa1d88b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:12.944796 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ae3dc264-216d-4ea7-a094-6d4e4aa1d88b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-133412315', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-133640812'] for subnet, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:12.973299 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae3dc264-216d-4ea7-a094-6d4e4aa1d88b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b521ad48-f786-4d81-985a-213254001050,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:12.977004 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ae3dc264-216d-4ea7-a094-6d4e4aa1d88b admin admin] Publish callbacks [] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:12.980348 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-ae3dc264-216d-4ea7-a094-6d4e4aa1d88b admin admin] 10.222.0.39 "DELETE /v2.0/subnets/b521ad48-f786-4d81-985a-213254001050 HTTP/1.1" status: 204 len: 168 time: 0.2762673 Dec 09 14:49:12.982979 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60568) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:12.987090 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9b66a5e-ff0a-4641-805b-21aadbcaaf43 None None] Network cb4a18f0-1b41-4505-8209-f321fa2fb718 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:49:13.066785 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:13.132699 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] Deleting port c380382f-4523-4464-b4ea-7bf6c35b35d8 {{(pid=109062) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:13.133046 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:13.200044 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.db [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] For port c380382f-4523-4464-b4ea-7bf6c35b35d8, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=c380382f-4523-4464-b4ea-7bf6c35b35d8,segment=NetworkSegment(88bbc0ad-3992-4920-a16f-cea3a608ea88),segment_id=88bbc0ad-3992-4920-a16f-cea3a608ea88)] {{(pid=109062) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:13.200724 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:13.212740 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] Calling delete_port for c380382f-4523-4464-b4ea-7bf6c35b35d8 owned by network:dhcp {{(pid=109062) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:13.294000 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5638eac-5fe2-47d3-8723-28fcfa8c140a None None] DHCP port deletion for cb4a18f0-1b41-4505-8209-f321fa2fb718 request from dv-cinder-819692-8-iscsi {{(pid=109063) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 14:49:13.312790 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:13.337849 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] No DVR routers for this DVR port c380382f-4523-4464-b4ea-7bf6c35b35d8 on host dv-cinder-819692-8-iscsi {{(pid=109062) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:49:13.384394 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] Pushing event deleted for resources: {'Port': ['ID=c380382f-4523-4464-b4ea-7bf6c35b35d8,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:13.410827 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-e5638eac-5fe2-47d3-8723-28fcfa8c140a None None] Deleting port c380382f-4523-4464-b4ea-7bf6c35b35d8 {{(pid=109063) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:13.414606 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-e5638eac-5fe2-47d3-8723-28fcfa8c140a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:13.439103 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 0893b89a-a8f4-46d8-8199-f1d43ad13d5e no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:49:13.523789 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 0893b89a-a8f4-46d8-8199-f1d43ad13d5e {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:49:13.524058 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 0893b89a-a8f4-46d8-8199-f1d43ad13d5e not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:49:13.525553 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 7b23c792-8975-498e-95fb-ead891ed2cec no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:49:13.529201 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1beee742-eba0-41eb-b034-9ba228725121 req-71ab7cca-9b57-4697-82ca-bdde9adf5443 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:13.530783 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1beee742-eba0-41eb-b034-9ba228725121 req-71ab7cca-9b57-4697-82ca-bdde9adf5443 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.1165831 Dec 09 14:49:13.538058 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:13.570559 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 7b23c792-8975-498e-95fb-ead891ed2cec {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:49:13.571192 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 7b23c792-8975-498e-95fb-ead891ed2cec not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:49:13.571817 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device c380382f-4523-4464-b4ea-7bf6c35b35d8 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:49:13.582804 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cb4a18f0-1b41-4505-8209-f321fa2fb718']}} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:13.608679 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: c380382f-4523-4464-b4ea-7bf6c35b35d8 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:49:13.609025 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device c380382f-4523-4464-b4ea-7bf6c35b35d8 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:49:13.612568 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '88bbc0ad-3992-4920-a16f-cea3a608ea88') {'for_net_delete': True} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:13.612867 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '88bbc0ad-3992-4920-a16f-cea3a608ea88') {} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:13.617822 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-e5638eac-5fe2-47d3-8723-28fcfa8c140a None None] For port c380382f-4523-4464-b4ea-7bf6c35b35d8, host dv-cinder-819692-8-iscsi, got binding levels [] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:13.618445 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-e5638eac-5fe2-47d3-8723-28fcfa8c140a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:13.629263 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1beee742-eba0-41eb-b034-9ba228725121 req-ceac3b74-a28a-4697-a08a-f1c85a3c8770 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0878561 Dec 09 14:49:13.631522 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-130415758'] for segment, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:13.648567 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:13.657948 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] Releasing vlan 420 on physical network physnet1 to pool {{(pid=109062) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:49:13.659876 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-130461398'] for segment, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: Traceback (most recent call last): Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: timer() Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: cb(*args, **kw) Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: return func(*args, **kwargs) Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: self._notify() Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: self.callback(batched_events) Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: event.method(event) Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: return f(self, *a, **k) Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._get(url).json() Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: return self.request(url, 'GET', **kwargs) Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:49:13.734993 dv-cinder-819692-8-iscsi neutron-server[109062]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:49:13.761033 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:13.769389 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:13.775171 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] 10.222.0.39 "DELETE /v2.0/networks/cb4a18f0-1b41-4505-8209-f321fa2fb718 HTTP/1.1" status: 204 len: 168 time: 0.7906959 Dec 09 14:49:13.799034 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99e5abe9-f6ff-4f4f-971f-40f8f25c4248 admin admin] Pushing event deleted for resources: {'Network': ['ID=cb4a18f0-1b41-4505-8209-f321fa2fb718,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:13.823529 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-e5638eac-5fe2-47d3-8723-28fcfa8c140a None None] Calling delete_port for c380382f-4523-4464-b4ea-7bf6c35b35d8 owned by network:dhcp {{(pid=109063) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:13.826562 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.ipam_backend_mixin [None req-e5638eac-5fe2-47d3-8723-28fcfa8c140a None None] Port c380382f-4523-4464-b4ea-7bf6c35b35d8 was not found and therefore no delete operation was performed {{(pid=109063) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 14:49:13.827864 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-e5638eac-5fe2-47d3-8723-28fcfa8c140a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959'] for port, after_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:13.838263 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-e5638eac-5fe2-47d3-8723-28fcfa8c140a None None] Network cb4a18f0-1b41-4505-8209-f321fa2fb718 is not hosted by any dhcp agent {{(pid=109063) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Dec 09 14:49:13.839031 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5638eac-5fe2-47d3-8723-28fcfa8c140a None None] No DVR routers for this DVR port c380382f-4523-4464-b4ea-7bf6c35b35d8 on host dv-cinder-819692-8-iscsi {{(pid=109063) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:49:13.858231 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5638eac-5fe2-47d3-8723-28fcfa8c140a None None] Pushing event deleted for resources: {'Port': ['ID=c380382f-4523-4464-b4ea-7bf6c35b35d8,revision_number=None']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:13.994481 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60580) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:14.036049 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-5a93d085-0641-4c40-88ca-63d295310ce3 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=ed13d07c829a42dca57ff23f7538ecda&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0412190 Dec 09 14:49:14.038623 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60582) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:14.092121 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-613ec4e8-1f6c-4451-8614-ceadfcea64a0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:14.113621 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-613ec4e8-1f6c-4451-8614-ceadfcea64a0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:14.161780 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-613ec4e8-1f6c-4451-8614-ceadfcea64a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:14.164405 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-613ec4e8-1f6c-4451-8614-ceadfcea64a0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:14.165614 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-613ec4e8-1f6c-4451-8614-ceadfcea64a0 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/7073d18f-f08a-4238-9251-53b9b9bf0865 HTTP/1.1" status: 204 len: 168 time: 0.1260397 Dec 09 14:49:14.173678 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-613ec4e8-1f6c-4451-8614-ceadfcea64a0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7073d18f-f08a-4238-9251-53b9b9bf0865,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:14.515129 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60590) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:14.558891 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-7fea5d64-369b-477e-8a36-da5c055828f7 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=aa21c3a67db0467f939fcab87f0358ac&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0416539 Dec 09 14:49:14.560836 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60594) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:14.625107 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2fa9f26d-e749-4442-aab0-b5501dae8f2b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:14.650080 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2fa9f26d-e749-4442-aab0-b5501dae8f2b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:14.712391 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2fa9f26d-e749-4442-aab0-b5501dae8f2b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:14.716707 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2fa9f26d-e749-4442-aab0-b5501dae8f2b admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:14.735454 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-2fa9f26d-e749-4442-aab0-b5501dae8f2b admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/1b37ef26-27cb-4111-82eb-4db42edef6a5 HTTP/1.1" status: 204 len: 168 time: 0.1587958 Dec 09 14:49:14.745505 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fa9f26d-e749-4442-aab0-b5501dae8f2b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b37ef26-27cb-4111-82eb-4db42edef6a5,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:14.808040 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e3fffe3-3ec7-4d1c-93cd-69caafd8c287 req-52a5e0e9-8c25-48e9-8296-548e74d12729 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:14.812296 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5e3fffe3-3ec7-4d1c-93cd-69caafd8c287 req-52a5e0e9-8c25-48e9-8296-548e74d12729 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0637939 Dec 09 14:49:14.846777 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:14.879891 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5e3fffe3-3ec7-4d1c-93cd-69caafd8c287 req-138d04d8-5c23-439d-b46e-f016fcd9d1a3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0630732 Dec 09 14:49:16.010939 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e01f1e00-a8d8-496e-b7cd-7922c357a439 req-526796b0-e2f1-4c1d-a5cd-58b62e1367c6 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:16.020554 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e01f1e00-a8d8-496e-b7cd-7922c357a439 req-526796b0-e2f1-4c1d-a5cd-58b62e1367c6 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0646036 Dec 09 14:49:16.041157 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60612) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:16.072000 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e01f1e00-a8d8-496e-b7cd-7922c357a439 req-847cbcfb-5daf-473d-b016-8ae0ce74a678 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458767 Dec 09 14:49:16.161058 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-881cb519-8eb2-458a-b3b4-34c927da7401 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:16.244038 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-881cb519-8eb2-458a-b3b4-34c927da7401 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:16.249625 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-881cb519-8eb2-458a-b3b4-34c927da7401 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:16.289984 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-881cb519-8eb2-458a-b3b4-34c927da7401 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=08bea98d-18dd-4823-b28f-b978151d69c5,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:16.294360 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-881cb519-8eb2-458a-b3b4-34c927da7401 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=4af5d9b8a955465598a0a568e49d8d06&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2521048 Dec 09 14:49:16.297193 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60616) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:16.351892 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-07be3e9d-23b6-4b65-86f7-a2d581ce90d0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:16.376161 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-07be3e9d-23b6-4b65-86f7-a2d581ce90d0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:16.422700 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-07be3e9d-23b6-4b65-86f7-a2d581ce90d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:16.425326 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-07be3e9d-23b6-4b65-86f7-a2d581ce90d0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:16.429100 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-07be3e9d-23b6-4b65-86f7-a2d581ce90d0 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/08bea98d-18dd-4823-b28f-b978151d69c5 HTTP/1.1" status: 204 len: 168 time: 0.1284945 Dec 09 14:49:16.436121 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07be3e9d-23b6-4b65-86f7-a2d581ce90d0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=08bea98d-18dd-4823-b28f-b978151d69c5,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:17.200054 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52e36f0e-4c49-4147-bc16-7f314e155991 req-514c14dc-33e2-4ad8-9c36-f380dbf4c428 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:17.201617 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-52e36f0e-4c49-4147-bc16-7f314e155991 req-514c14dc-33e2-4ad8-9c36-f380dbf4c428 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0510101 Dec 09 14:49:17.251906 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-52e36f0e-4c49-4147-bc16-7f314e155991 req-150d60dd-a22a-41a3-afff-95b7a77b7146 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440156 Dec 09 14:49:18.382622 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-380b74f2-3a1d-4832-aa46-5e0cca139dc1 req-435799cc-b8a5-4992-840e-e95bfd139fdc tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:18.384235 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-380b74f2-3a1d-4832-aa46-5e0cca139dc1 req-435799cc-b8a5-4992-840e-e95bfd139fdc tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0556805 Dec 09 14:49:18.434869 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-380b74f2-3a1d-4832-aa46-5e0cca139dc1 req-bdb3b86e-a495-4e8c-9317-1899bff743ad tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436862 Dec 09 14:49:19.569892 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1f375d1-991a-4fda-b0a9-e47061e49f9b req-2383d1b2-f7c0-4d70-9847-db2f250f4717 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:19.571570 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a1f375d1-991a-4fda-b0a9-e47061e49f9b req-2383d1b2-f7c0-4d70-9847-db2f250f4717 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0568151 Dec 09 14:49:19.625186 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a1f375d1-991a-4fda-b0a9-e47061e49f9b req-bcee9736-a449-4d2b-b57a-b2719d2f103c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475812 Dec 09 14:49:20.760775 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efa8cf77-f47d-4cb4-9ad4-ba83afd3f146 req-19087d38-593a-4a4a-8ed8-5913427a6b07 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:20.762271 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-efa8cf77-f47d-4cb4-9ad4-ba83afd3f146 req-19087d38-593a-4a4a-8ed8-5913427a6b07 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0573931 Dec 09 14:49:20.812202 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-efa8cf77-f47d-4cb4-9ad4-ba83afd3f146 req-ef64c932-17a6-440c-886c-054ca550fd23 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439146 Dec 09 14:49:21.948595 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a82562d0-2dc6-4c38-8c66-45e9cc5434f2 req-543a83ee-18b0-4ab8-a3a3-684acb055579 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:21.950035 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a82562d0-2dc6-4c38-8c66-45e9cc5434f2 req-543a83ee-18b0-4ab8-a3a3-684acb055579 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0509772 Dec 09 14:49:22.002407 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a82562d0-2dc6-4c38-8c66-45e9cc5434f2 req-678fc4c8-b060-450e-8657-344bf3e8e7da tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451686 Dec 09 14:49:23.150430 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d090950a-bc89-441f-8e6e-8864f90fbb7b req-3b1bea41-b0ac-4cdc-9522-686b59105c5f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:23.151971 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d090950a-bc89-441f-8e6e-8864f90fbb7b req-3b1bea41-b0ac-4cdc-9522-686b59105c5f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0558896 Dec 09 14:49:23.200297 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d090950a-bc89-441f-8e6e-8864f90fbb7b req-3c504fb7-a615-4b13-a5f2-73bb877577fe tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421720 Dec 09 14:49:24.342613 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-291587ac-0bdb-426d-ab7b-4df317c91adb req-a3aa5bf5-9ad5-48d6-8f22-d14ae7b888d7 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:24.344169 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-291587ac-0bdb-426d-ab7b-4df317c91adb req-a3aa5bf5-9ad5-48d6-8f22-d14ae7b888d7 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 944 time: 0.0522060 Dec 09 14:49:24.394523 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-291587ac-0bdb-426d-ab7b-4df317c91adb req-7f38256d-1123-45de-a0a3-b6397e417b6a tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442336 Dec 09 14:49:25.213559 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device d37591e8-0953-4fbc-9688-71f4c813e43c details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:49:25.322366 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port d37591e8-0953-4fbc-9688-71f4c813e43c, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=d37591e8-0953-4fbc-9688-71f4c813e43c,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:25.334208 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'port_id': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'mac_address': 'fa:16:3e:86:68:b2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 412, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:49:25.374353 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:25.387556 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d37591e8-0953-4fbc-9688-71f4c813e43c {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:49:25.406988 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port d37591e8-0953-4fbc-9688-71f4c813e43c, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=d37591e8-0953-4fbc-9688-71f4c813e43c,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:25.412678 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:25.461424 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=d37591e8-0953-4fbc-9688-71f4c813e43c,revision_number=9']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:25.519897 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3739256d-c824-4070-9974-bdac03be8c02 req-ea5f35ff-883b-41c7-8cf7-bd9d07f67214 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:25.521385 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3739256d-c824-4070-9974-bdac03be8c02 req-ea5f35ff-883b-41c7-8cf7-bd9d07f67214 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 945 time: 0.0510962 Dec 09 14:49:25.576970 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3739256d-c824-4070-9974-bdac03be8c02 req-1225088e-6b82-43f3-beba-a657a969471c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493426 Dec 09 14:49:25.650239 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['d37591e8-0953-4fbc-9688-71f4c813e43c'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:49:26.705279 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fef7ff8f-9300-4b25-8d58-ca22d0de457f req-4b91dd25-c313-4067-a648-74c0b9e23268 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:26.706835 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fef7ff8f-9300-4b25-8d58-ca22d0de457f req-4b91dd25-c313-4067-a648-74c0b9e23268 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 945 time: 0.0516288 Dec 09 14:49:26.760056 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fef7ff8f-9300-4b25-8d58-ca22d0de457f req-89d32e4e-997a-4a52-aaea-50371076b326 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463398 Dec 09 14:49:27.026077 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4d22143e-b0f0-468d-98c2-b84b5904325a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:27.212127 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device d37591e8-0953-4fbc-9688-71f4c813e43c up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:49:27.274852 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port d37591e8-0953-4fbc-9688-71f4c813e43c triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:49:27.275240 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:27.363505 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:27.386809 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '496052b6-9737-4680-bcd6-64721946b1a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd37591e8-0953-4fbc-9688-71f4c813e43c'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:49:27.389117 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f4a2a6aa-de06-497f-8e7c-017c6c868f81" -d '{"events": [{"server_uuid": "496052b6-9737-4680-bcd6-64721946b1a4", "name": "network-vif-plugged", "status": "completed", "tag": "d37591e8-0953-4fbc-9688-71f4c813e43c"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:49:27.402106 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port d37591e8-0953-4fbc-9688-71f4c813e43c, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=d37591e8-0953-4fbc-9688-71f4c813e43c,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:27.408896 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:27.434558 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:49:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4dc2f21c-128c-447f-965f-66d46c79c41d x-openstack-request-id: req-4dc2f21c-128c-447f-965f-66d46c79c41d {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:49:27.434862 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "496052b6-9737-4680-bcd6-64721946b1a4", "name": "network-vif-plugged", "status": "completed", "tag": "d37591e8-0953-4fbc-9688-71f4c813e43c", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:49:27.435233 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-4dc2f21c-128c-447f-965f-66d46c79c41d {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:49:27.435645 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '496052b6-9737-4680-bcd6-64721946b1a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'code': 200} Dec 09 14:49:27.462307 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=d37591e8-0953-4fbc-9688-71f4c813e43c,revision_number=10']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:27.469586 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:27.469954 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:27.470310 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:27.470652 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:27.470996 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:27.471332 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:27.471695 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:27.472032 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:27.472396 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:27.472699 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:27.473027 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:27.473353 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:27.473678 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:27.625678 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66b4cb4d-5c28-4434-80fd-6cf7f444f097 req-26e4c629-4f77-47b2-83e2-d8f936c73662 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:27.628296 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-66b4cb4d-5c28-4434-80fd-6cf7f444f097 req-26e4c629-4f77-47b2-83e2-d8f936c73662 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 1100 time: 0.0476754 Dec 09 14:49:27.688269 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-66b4cb4d-5c28-4434-80fd-6cf7f444f097 req-01cf0a19-0493-4aec-9b3a-7ae7f7304b25 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0528164 Dec 09 14:49:27.910754 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6746836f-64ac-4ed4-8d83-88f5abc8aa3f req-24ffe7d7-3a15-4045-8671-68ed03a8e25f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:27.912267 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6746836f-64ac-4ed4-8d83-88f5abc8aa3f req-24ffe7d7-3a15-4045-8671-68ed03a8e25f tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 947 time: 0.0572646 Dec 09 14:49:27.966384 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-6746836f-64ac-4ed4-8d83-88f5abc8aa3f req-7df02ba8-0d0c-41b2-afaf-66fdd74d63d3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464201 Dec 09 14:49:29.097109 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5177565-bd53-4708-8fb9-7cb341e7419f req-bd780a8d-8943-41cf-893c-d274a624a04b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:29.098638 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a5177565-bd53-4708-8fb9-7cb341e7419f req-bd780a8d-8943-41cf-893c-d274a624a04b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 947 time: 0.0523930 Dec 09 14:49:29.150168 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a5177565-bd53-4708-8fb9-7cb341e7419f req-f9edd767-9822-470e-9dce-a471306e5470 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448000 Dec 09 14:49:29.190924 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-434b6494-919d-4dcd-a8ff-4a69a13d0dab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:30.290356 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f24b40df-e640-465c-9bc8-4835c5ed6a82 req-6be00f1b-d98c-4906-a25f-8a50a3f4542e tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:30.291901 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f24b40df-e640-465c-9bc8-4835c5ed6a82 req-6be00f1b-d98c-4906-a25f-8a50a3f4542e tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 947 time: 0.0540924 Dec 09 14:49:30.343969 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f24b40df-e640-465c-9bc8-4835c5ed6a82 req-e9d22fe5-2dda-41d6-976f-6fddc397e735 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459406 Dec 09 14:49:30.439045 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:31.816614 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:32.610931 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:36.440696 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:49:44.840649 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:46.801812 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5801a05c-3e2b-4f99-9730-1c410a39eb18 req-92494211-da04-4e72-a79b-c6e13c4b3d48 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0411084 Dec 09 14:49:46.863124 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5801a05c-3e2b-4f99-9730-1c410a39eb18 req-557d748f-21e3-46c6-80b3-5275c6c33e09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:46.864615 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5801a05c-3e2b-4f99-9730-1c410a39eb18 req-557d748f-21e3-46c6-80b3-5275c6c33e09 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=6be5d78d2d0049448c3947b4e650758a&device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 1100 time: 0.0400548 Dec 09 14:49:46.974720 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5801a05c-3e2b-4f99-9730-1c410a39eb18 req-f3c2db59-442c-45d6-9eec-a223d73653f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:46.976172 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5801a05c-3e2b-4f99-9730-1c410a39eb18 req-f3c2db59-442c-45d6-9eec-a223d73653f2 service neutron] 10.222.0.44 "GET /v2.0/networks?id=9ab3f8b6-44d0-4210-907d-0e96072c4566 HTTP/1.1" status: 200 len: 917 time: 0.0872104 Dec 09 14:49:47.052883 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5801a05c-3e2b-4f99-9730-1c410a39eb18 req-983bb769-6886-405b-b728-15cc817dfafe service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=d37591e8-0953-4fbc-9688-71f4c813e43c HTTP/1.1" status: 200 len: 1002 time: 0.0666945 Dec 09 14:49:47.104588 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5801a05c-3e2b-4f99-9730-1c410a39eb18 req-1531042c-e240-4e06-a8b0-a0c4d68a50d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:47.106016 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5801a05c-3e2b-4f99-9730-1c410a39eb18 req-1531042c-e240-4e06-a8b0-a0c4d68a50d8 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=f10f1097-5d43-4737-bcac-a27ade66b442 HTTP/1.1" status: 200 len: 855 time: 0.0457520 Dec 09 14:49:47.155287 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5801a05c-3e2b-4f99-9730-1c410a39eb18 req-49f5ddec-dc07-4af2-a77b-1b76d043f79f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:47.156961 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5801a05c-3e2b-4f99-9730-1c410a39eb18 req-49f5ddec-dc07-4af2-a77b-1b76d043f79f service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=9ab3f8b6-44d0-4210-907d-0e96072c4566&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0433929 Dec 09 14:49:47.245250 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5801a05c-3e2b-4f99-9730-1c410a39eb18 req-7bc1bf2e-fa5e-4d94-8961-413e392012c7 service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0792601 Dec 09 14:49:47.341229 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-5801a05c-3e2b-4f99-9730-1c410a39eb18 req-be593a71-a885-463b-b423-9dd4882bcf52 service neutron] 10.222.0.44 "GET /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0890734 Dec 09 14:49:50.066754 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60776) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:50.387634 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-5f09836c-0bf5-4803-b7fa-2655f35f31fe tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Deleting port 5130d9f4-9a43-42a5-ab9c-4bd3f4d812f7 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:50.387883 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5f09836c-0bf5-4803-b7fa-2655f35f31fe tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:50.467311 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5f09836c-0bf5-4803-b7fa-2655f35f31fe tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:50.467624 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5f09836c-0bf5-4803-b7fa-2655f35f31fe tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:50.480063 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-5f09836c-0bf5-4803-b7fa-2655f35f31fe tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Calling delete_port for 5130d9f4-9a43-42a5-ab9c-4bd3f4d812f7 owned by network:floatingip {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:50.657122 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5f09836c-0bf5-4803-b7fa-2655f35f31fe tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:50.685146 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f09836c-0bf5-4803-b7fa-2655f35f31fe tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Pushing event deleted for resources: {'Port': ['ID=5130d9f4-9a43-42a5-ab9c-4bd3f4d812f7,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:50.747507 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5f09836c-0bf5-4803-b7fa-2655f35f31fe tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for floatingip, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:50.747865 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.l3_db [None req-5f09836c-0bf5-4803-b7fa-2655f35f31fe tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Floating IP eb1ffbd2-71c3-4e95-8adb-88c59352e84d disassociated (deleted). External IP: 172.27.0.128, port: e44baa3b-39d9-4337-9599-d357f2381c7d. Dec 09 14:49:50.962817 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5f09836c-0bf5-4803-b7fa-2655f35f31fe tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:49:51.070002 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5f09836c-0bf5-4803-b7fa-2655f35f31fe tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:49:51.074838 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5f09836c-0bf5-4803-b7fa-2655f35f31fe tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:51.083339 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c14cb95-770b-456e-b857-3d4af25d3546 None None] Sync routers for ids ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:49:51.094279 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c14cb95-770b-456e-b857-3d4af25d3546 None None] Routers {'ff4d224c-d767-4521-9fd6-3bfbaaddfe44'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:49:51.094956 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-8c14cb95-770b-456e-b857-3d4af25d3546 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:49:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:51.101619 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-5f09836c-0bf5-4803-b7fa-2655f35f31fe tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "DELETE /v2.0/floatingips/eb1ffbd2-71c3-4e95-8adb-88c59352e84d HTTP/1.1" status: 204 len: 168 time: 1.0335243 Dec 09 14:49:51.102187 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'tag': 'e44baa3b-39d9-4337-9599-d357f2381c7d'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:49:51.104505 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-01451228-0286-49e3-a409-185e8300ade3" -d '{"events": [{"name": "network-changed", "server_uuid": "fb81e6b3-1e55-4186-be5b-5f51f6563593", "tag": "e44baa3b-39d9-4337-9599-d357f2381c7d"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:49:51.143676 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:49:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-88d7c437-da26-4d3c-a14d-70d4bdc393e6 x-openstack-request-id: req-88d7c437-da26-4d3c-a14d-70d4bdc393e6 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:49:51.144731 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fb81e6b3-1e55-4186-be5b-5f51f6563593", "tag": "e44baa3b-39d9-4337-9599-d357f2381c7d", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:49:51.144963 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-88d7c437-da26-4d3c-a14d-70d4bdc393e6 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:49:51.145514 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'tag': 'e44baa3b-39d9-4337-9599-d357f2381c7d', 'status': 'completed', 'code': 200} Dec 09 14:49:51.209109 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-8c14cb95-770b-456e-b857-3d4af25d3546 None None] Set router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:49:51.212535 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01451228-0286-49e3-a409-185e8300ade3 req-ddf9d021-d32d-44ed-89ff-38d306d2cf4f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:51.214057 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-01451228-0286-49e3-a409-185e8300ade3 req-ddf9d021-d32d-44ed-89ff-38d306d2cf4f service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=10d73d0acf44499e88f6d53847b2094e&device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 1098 time: 0.0440192 Dec 09 14:49:51.318925 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01451228-0286-49e3-a409-185e8300ade3 req-da425716-c1eb-49a3-ba19-6bae42d88bf9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:51.320497 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-01451228-0286-49e3-a409-185e8300ade3 req-da425716-c1eb-49a3-ba19-6bae42d88bf9 service neutron] 10.222.0.44 "GET /v2.0/networks?id=f0982548-601b-4206-88dc-a16a0317b421 HTTP/1.1" status: 200 len: 909 time: 0.0947993 Dec 09 14:49:51.332283 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a86b0aad-a03f-46ca-8dcc-f75cec841f08 req-ee9cc586-890e-4d2c-a018-beacacb58d13 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:51.333760 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a86b0aad-a03f-46ca-8dcc-f75cec841f08 req-ee9cc586-890e-4d2c-a018-beacacb58d13 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0485656 Dec 09 14:49:51.364058 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-01451228-0286-49e3-a409-185e8300ade3 req-595bd35d-7c89-4027-b0d1-992de7342185 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=e44baa3b-39d9-4337-9599-d357f2381c7d HTTP/1.1" status: 200 len: 217 time: 0.0350816 Dec 09 14:49:51.385140 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a86b0aad-a03f-46ca-8dcc-f75cec841f08 req-f7751df4-5c89-41ed-8959-166f2177bf9b tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438852 Dec 09 14:49:51.411834 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-8c14cb95-770b-456e-b857-3d4af25d3546 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:50Z', 'updated_at': '2021-12-09T14:43:56Z', 'revision_number': 4, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'gw_port': {'id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:38:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:51Z', 'updated_at': '2021-12-09T14:43:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'c3bcca35-88a0-437e-a9e8-3bcbcd962647', 'name': '', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'mac_address': 'fa:16:3e:97:bd:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_interface', 'standard_attr_id': 277, 'fixed_ips': [{'subnet_id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:55Z', 'updated_at': '2021-12-09T14:44:02Z', 'revision_number': 5, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'subnets': [{'id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:51.417656 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01451228-0286-49e3-a409-185e8300ade3 req-3e37a5b6-cdcd-4d55-83ef-4a3483464176 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:51.419169 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-01451228-0286-49e3-a409-185e8300ade3 req-3e37a5b6-cdcd-4d55-83ef-4a3483464176 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=7edf1e5e-d953-4e3c-8dc5-29475e258db2 HTTP/1.1" status: 200 len: 847 time: 0.0474970 Dec 09 14:49:51.437439 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c14cb95-770b-456e-b857-3d4af25d3546 None None] Checking router: ff4d224c-d767-4521-9fd6-3bfbaaddfe44 for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:49:51.445926 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c14cb95-770b-456e-b857-3d4af25d3546 None None] Routers {'ff4d224c-d767-4521-9fd6-3bfbaaddfe44'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:49:51.446543 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-8c14cb95-770b-456e-b857-3d4af25d3546 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:49:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:51.471302 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01451228-0286-49e3-a409-185e8300ade3 req-bfefca73-5e44-48d0-b9f7-b1b16d75408a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:51.472847 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-01451228-0286-49e3-a409-185e8300ade3 req-bfefca73-5e44-48d0-b9f7-b1b16d75408a service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=f0982548-601b-4206-88dc-a16a0317b421&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0433691 Dec 09 14:49:51.552400 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-8c14cb95-770b-456e-b857-3d4af25d3546 None None] Set router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:49:51.566003 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-01451228-0286-49e3-a409-185e8300ade3 req-50354bdd-fcb0-4a07-b86d-773094aa4966 service neutron] 10.222.0.44 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0811520 Dec 09 14:49:51.768537 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-8c14cb95-770b-456e-b857-3d4af25d3546 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:50Z', 'updated_at': '2021-12-09T14:43:56Z', 'revision_number': 4, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'gw_port': {'id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:38:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:51Z', 'updated_at': '2021-12-09T14:43:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'c3bcca35-88a0-437e-a9e8-3bcbcd962647', 'name': '', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'mac_address': 'fa:16:3e:97:bd:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_interface', 'standard_attr_id': 277, 'fixed_ips': [{'subnet_id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:55Z', 'updated_at': '2021-12-09T14:44:02Z', 'revision_number': 5, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'subnets': [{'id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:51.797236 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8c14cb95-770b-456e-b857-3d4af25d3546 None None] The sync data for ids ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'] in dv-cinder-819692-8-iscsi is: [{'id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:50Z', 'updated_at': '2021-12-09T14:43:56Z', 'revision_number': 4, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'gw_port': {'id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:38:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:51Z', 'updated_at': '2021-12-09T14:43:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'c3bcca35-88a0-437e-a9e8-3bcbcd962647', 'name': '', 'network_id': 'f0982548-601b-4206-88dc-a16a0317b421', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'mac_address': 'fa:16:3e:97:bd:b5', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_interface', 'standard_attr_id': 277, 'fixed_ips': [{'subnet_id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:55Z', 'updated_at': '2021-12-09T14:44:02Z', 'revision_number': 5, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'subnets': [{'id': '7edf1e5e-d953-4e3c-8dc5-29475e258db2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:49:51.932085 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-01451228-0286-49e3-a409-185e8300ade3 req-7138aa05-657a-4117-bfed-16e90237a898 service neutron] 10.222.0.44 "GET /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3562517 Dec 09 14:49:52.035355 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-56e1f161-4c56-46b4-9f73-8a118d465820 None None] New status for floating IP eb1ffbd2-71c3-4e95-8adb-88c59352e84d: DOWN {{(pid=109064) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:49:52.509821 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a35aad6a-7e53-425b-b768-3af7d75ea346 req-d4935053-ded8-4def-b344-caa170fa3f26 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:52.511337 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a35aad6a-7e53-425b-b768-3af7d75ea346 req-d4935053-ded8-4def-b344-caa170fa3f26 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0555177 Dec 09 14:49:52.560674 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-a35aad6a-7e53-425b-b768-3af7d75ea346 req-93b112ef-0e23-4b32-a201-e60799f7fddd tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/security-groups?id=15ffbd79-f4ea-441f-8956-2c10355c90c0&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429819 Dec 09 14:49:52.894061 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bf7367f-84ed-45f7-a34b-df2fb3173d52 req-34e4d16a-d8a8-464a-9254-b05ec3813987 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:52.895513 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9bf7367f-84ed-45f7-a34b-df2fb3173d52 req-34e4d16a-d8a8-464a-9254-b05ec3813987 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.44 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 945 time: 0.0569344 Dec 09 14:49:52.996651 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-9bf7367f-84ed-45f7-a34b-df2fb3173d52 req-dfe3e8a0-f047-459f-b5a3-f089b8964add tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Deleting port e44baa3b-39d9-4337-9599-d357f2381c7d {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:52.997003 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-9bf7367f-84ed-45f7-a34b-df2fb3173d52 req-dfe3e8a0-f047-459f-b5a3-f089b8964add tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:53.088515 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-9bf7367f-84ed-45f7-a34b-df2fb3173d52 req-dfe3e8a0-f047-459f-b5a3-f089b8964add tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] For port e44baa3b-39d9-4337-9599-d357f2381c7d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=e44baa3b-39d9-4337-9599-d357f2381c7d,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:53.088893 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-9bf7367f-84ed-45f7-a34b-df2fb3173d52 req-dfe3e8a0-f047-459f-b5a3-f089b8964add tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:53.101904 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-9bf7367f-84ed-45f7-a34b-df2fb3173d52 req-dfe3e8a0-f047-459f-b5a3-f089b8964add tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Calling delete_port for e44baa3b-39d9-4337-9599-d357f2381c7d owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:53.239724 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-9bf7367f-84ed-45f7-a34b-df2fb3173d52 req-dfe3e8a0-f047-459f-b5a3-f089b8964add tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:53.268408 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfe3e8a0-f047-459f-b5a3-f089b8964add tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Pushing event deleted for resources: {'Port': ['ID=e44baa3b-39d9-4337-9599-d357f2381c7d,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:53.311271 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-9bf7367f-84ed-45f7-a34b-df2fb3173d52 req-dfe3e8a0-f047-459f-b5a3-f089b8964add tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] No DVR routers for this DVR port e44baa3b-39d9-4337-9599-d357f2381c7d on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:49:53.313874 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-9bf7367f-84ed-45f7-a34b-df2fb3173d52 req-dfe3e8a0-f047-459f-b5a3-f089b8964add tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:53.317983 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9bf7367f-84ed-45f7-a34b-df2fb3173d52 req-dfe3e8a0-f047-459f-b5a3-f089b8964add tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.44 "DELETE /v2.0/ports/e44baa3b-39d9-4337-9599-d357f2381c7d HTTP/1.1" status: 204 len: 173 time: 0.4133317 Dec 09 14:49:53.318642 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'name': 'network-vif-deleted', 'tag': 'e44baa3b-39d9-4337-9599-d357f2381c7d'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:49:53.321446 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a5b85fef-674d-497e-8d0f-e30a1f7e22fc" -d '{"events": [{"server_uuid": "fb81e6b3-1e55-4186-be5b-5f51f6563593", "name": "network-vif-deleted", "tag": "e44baa3b-39d9-4337-9599-d357f2381c7d"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:49:53.363125 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:49:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8f2ee446-940e-417e-b0aa-f5a3c6f09658 x-openstack-request-id: req-8f2ee446-940e-417e-b0aa-f5a3c6f09658 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:49:53.363540 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fb81e6b3-1e55-4186-be5b-5f51f6563593", "name": "network-vif-deleted", "tag": "e44baa3b-39d9-4337-9599-d357f2381c7d", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:49:53.363824 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-8f2ee446-940e-417e-b0aa-f5a3c6f09658 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:49:53.364230 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fb81e6b3-1e55-4186-be5b-5f51f6563593', 'name': 'network-vif-deleted', 'tag': 'e44baa3b-39d9-4337-9599-d357f2381c7d', 'status': 'completed', 'code': 200} Dec 09 14:49:53.682865 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-8231645d-5a1b-4f8b-a78e-f6576d3d06e1 req-ab854ed1-18af-4e5a-bf5e-8373b45831a4 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "GET /v2.0/ports?device_id=fb81e6b3-1e55-4186-be5b-5f51f6563593 HTTP/1.1" status: 200 len: 210 time: 0.0338314 Dec 09 14:49:54.741291 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60828) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:54.803981 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1bf882d1-b183-4696-9567-d870d27503b3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:54.830186 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1bf882d1-b183-4696-9567-d870d27503b3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:54.892335 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1bf882d1-b183-4696-9567-d870d27503b3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:54.895912 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1bf882d1-b183-4696-9567-d870d27503b3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:54.897746 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-1bf882d1-b183-4696-9567-d870d27503b3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] 10.222.0.39 "DELETE /v2.0/security-groups/15ffbd79-f4ea-441f-8956-2c10355c90c0 HTTP/1.1" status: 204 len: 168 time: 0.1552217 Dec 09 14:49:54.908439 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bf882d1-b183-4696-9567-d870d27503b3 tempest-TestShelveInstance-1108872357 tempest-TestShelveInstance-1108872357-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=15ffbd79-f4ea-441f-8956-2c10355c90c0,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:54.956152 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60832) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:55.417428 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3399156e-9b2a-4c26-b110-f61edec8449c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1629277'] for router_interface, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:55.526100 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48392933-36bc-403c-8602-003c71e0a4cb req-a99b2928-17ad-4943-9b41-13e65aaf6c51 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:55.528932 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-48392933-36bc-403c-8602-003c71e0a4cb req-a99b2928-17ad-4943-9b41-13e65aaf6c51 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 945 time: 0.0524445 Dec 09 14:49:55.578226 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-48392933-36bc-403c-8602-003c71e0a4cb req-e3cfcc8f-1cc9-4e1a-81bf-04e9e3448651 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=927687a4-aeb0-458e-b110-0ce356cf2037&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429075 Dec 09 14:49:55.668310 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-3399156e-9b2a-4c26-b110-f61edec8449c admin admin] Deleting port c3bcca35-88a0-437e-a9e8-3bcbcd962647 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:55.668660 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3399156e-9b2a-4c26-b110-f61edec8449c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:55.751755 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-3399156e-9b2a-4c26-b110-f61edec8449c admin admin] For port c3bcca35-88a0-437e-a9e8-3bcbcd962647, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=c3bcca35-88a0-437e-a9e8-3bcbcd962647,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:55.752549 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3399156e-9b2a-4c26-b110-f61edec8449c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:55.764999 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-3399156e-9b2a-4c26-b110-f61edec8449c admin admin] Calling delete_port for c3bcca35-88a0-437e-a9e8-3bcbcd962647 owned by network:router_interface {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:55.950543 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3399156e-9b2a-4c26-b110-f61edec8449c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:55.975690 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3399156e-9b2a-4c26-b110-f61edec8449c admin admin] Pushing event deleted for resources: {'Port': ['ID=c3bcca35-88a0-437e-a9e8-3bcbcd962647,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:56.143283 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3399156e-9b2a-4c26-b110-f61edec8449c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2066028', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1629233'] for router_interface, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:56.356083 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3399156e-9b2a-4c26-b110-f61edec8449c admin admin] Router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:49:56.466644 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3399156e-9b2a-4c26-b110-f61edec8449c admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:49:56.471697 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-3399156e-9b2a-4c26-b110-f61edec8449c admin admin] 10.222.0.39 "PUT /v2.0/routers/ff4d224c-d767-4521-9fd6-3bfbaaddfe44/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5144060 Dec 09 14:49:56.474411 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60854) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:56.476625 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f55ee6c9-205b-4a63-a758-5a7a28edcb3e None None] Sync routers for ids ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:49:56.487512 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f55ee6c9-205b-4a63-a758-5a7a28edcb3e None None] Routers {'ff4d224c-d767-4521-9fd6-3bfbaaddfe44'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:49:56.488338 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-f55ee6c9-205b-4a63-a758-5a7a28edcb3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:49:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:56.578460 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] Publish callbacks [] for router, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:56.592817 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-f55ee6c9-205b-4a63-a758-5a7a28edcb3e None None] Set router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:49:56.718103 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8980dc2-5dfa-47fa-9a28-615f89ead66f req-d533117a-d3c3-4599-ab53-25c901c04612 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:56.719634 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d8980dc2-5dfa-47fa-9a28-615f89ead66f req-d533117a-d3c3-4599-ab53-25c901c04612 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 945 time: 0.0638278 Dec 09 14:49:56.721736 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:56.774164 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-f55ee6c9-205b-4a63-a758-5a7a28edcb3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153'}], 'enable_snat': True}, 'gw_port_id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:50Z', 'updated_at': '2021-12-09T14:49:55Z', 'revision_number': 5, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'gw_port': {'id': 'd811a33d-c420-4cb6-9ca9-cc0a9c770df5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:8f:38:3d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'device_owner': 'network:router_gateway', 'standard_attr_id': 260, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.153', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:43:51Z', 'updated_at': '2021-12-09T14:43:59Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:56.797135 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d8980dc2-5dfa-47fa-9a28-615f89ead66f req-b1a377af-4db9-4d44-85cc-67582051737a tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=927687a4-aeb0-458e-b110-0ce356cf2037&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0699060 Dec 09 14:49:56.805285 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f55ee6c9-205b-4a63-a758-5a7a28edcb3e None None] Checking router: ff4d224c-d767-4521-9fd6-3bfbaaddfe44 for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:49:56.811893 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] Deleting port d811a33d-c420-4cb6-9ca9-cc0a9c770df5 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:56.812233 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:56.814670 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f55ee6c9-205b-4a63-a758-5a7a28edcb3e None None] Routers {'ff4d224c-d767-4521-9fd6-3bfbaaddfe44'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:49:56.815349 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-f55ee6c9-205b-4a63-a758-5a7a28edcb3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:49:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:56.895439 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] For port d811a33d-c420-4cb6-9ca9-cc0a9c770df5, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=d811a33d-c420-4cb6-9ca9-cc0a9c770df5,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:56.895784 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:56.910465 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] Calling delete_port for d811a33d-c420-4cb6-9ca9-cc0a9c770df5 owned by network:router_gateway {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:57.032716 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-225c199b-c08c-4a9a-8df0-0dd8238a7374 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.046814 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-f55ee6c9-205b-4a63-a758-5a7a28edcb3e None None] Set router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 gateway port host: None {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:49:57.086254 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.100822 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-f55ee6c9-205b-4a63-a758-5a7a28edcb3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:50Z', 'updated_at': '2021-12-09T14:49:56Z', 'revision_number': 6, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'gw_port_host': None}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:57.117181 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] Pushing event deleted for resources: {'Port': ['ID=d811a33d-c420-4cb6-9ca9-cc0a9c770df5,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:57.132188 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f55ee6c9-205b-4a63-a758-5a7a28edcb3e None None] The sync data for ids ['ff4d224c-d767-4521-9fd6-3bfbaaddfe44'] in dv-cinder-819692-8-iscsi is: [{'id': 'ff4d224c-d767-4521-9fd6-3bfbaaddfe44', 'name': 'tempest-TestShelveInstance-663400605-router', 'tenant_id': '10d73d0acf44499e88f6d53847b2094e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:50Z', 'updated_at': '2021-12-09T14:49:56Z', 'revision_number': 6, 'project_id': '10d73d0acf44499e88f6d53847b2094e', 'gw_port_host': None}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:49:57.180991 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1574291'] for router_gateway, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.268798 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1626627', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30560'] for router, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.270996 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.318081 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1626682'] for router, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.318819 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] Fanout notify agent at l3_agent the message router_deleted on router ff4d224c-d767-4521-9fd6-3bfbaaddfe44 {{(pid=109061) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 14:49:57.323509 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.324747 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-fa56a226-0a43-41ad-b289-136c9cb1474f admin admin] 10.222.0.39 "DELETE /v2.0/routers/ff4d224c-d767-4521-9fd6-3bfbaaddfe44 HTTP/1.1" status: 204 len: 168 time: 0.8494542 Dec 09 14:49:57.327472 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60858) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:57.352815 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device e44baa3b-39d9-4337-9599-d357f2381c7d no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:49:57.373471 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: e44baa3b-39d9-4337-9599-d357f2381c7d {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:49:57.373714 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_v2 [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Deleting subnet 7edf1e5e-d953-4e3c-8dc5-29475e258db2 {{(pid=109062) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:49:57.373904 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device e44baa3b-39d9-4337-9599-d357f2381c7d not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:49:57.376989 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.415485 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-130415749'] for subnet, precommit_delete_associations {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.427256 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-3a87fa7b-cdbc-4bc4-adf6-7bbfb030599a tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:57.428751 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-3a87fa7b-cdbc-4bc4-adf6-7bbfb030599a tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.44 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 945 time: 0.0528314 Dec 09 14:49:57.523190 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-0b8be6d7-68cb-4aa9-880a-fefb6e3bb37b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Deleting port aa786f00-e147-482f-b4af-854ade7971b7 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:57.523571 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-0b8be6d7-68cb-4aa9-880a-fefb6e3bb37b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.525606 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.587179 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-130461228', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-130768914'] for subnet, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.620170 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7edf1e5e-d953-4e3c-8dc5-29475e258db2,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:57.624641 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.630730 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e51a1d5f-a9a9-4447-bb4a-847460dbd5ee None None] Network f0982548-601b-4206-88dc-a16a0317b421 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:49:57.631844 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] 10.222.0.39 "DELETE /v2.0/subnets/7edf1e5e-d953-4e3c-8dc5-29475e258db2 HTTP/1.1" status: 204 len: 168 time: 0.2996883 Dec 09 14:49:57.632503 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60860) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:57.639166 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:57.639527 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:57.640104 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:57.640455 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:57.640817 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:57.641164 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:57.641648 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:57.642153 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:57.642684 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:57.643202 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:57.643534 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:57.644051 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:57.644533 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-98162799-9feb-45ef-bae6-6b1e4e63c2e6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:49:57.691233 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-0b8be6d7-68cb-4aa9-880a-fefb6e3bb37b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] For port aa786f00-e147-482f-b4af-854ade7971b7, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=aa786f00-e147-482f-b4af-854ade7971b7,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:57.691508 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-0b8be6d7-68cb-4aa9-880a-fefb6e3bb37b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.755556 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.909584 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-0b8be6d7-68cb-4aa9-880a-fefb6e3bb37b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.910261 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-0b8be6d7-68cb-4aa9-880a-fefb6e3bb37b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.910261 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.l3_db [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-0b8be6d7-68cb-4aa9-880a-fefb6e3bb37b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Floating IP 8c911938-4c2f-4ad8-a14e-02e817758c6d disassociated. External IP: 172.27.0.75, port: aa786f00-e147-482f-b4af-854ade7971b7. Dec 09 14:49:57.910491 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-0b8be6d7-68cb-4aa9-880a-fefb6e3bb37b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Calling delete_port for aa786f00-e147-482f-b4af-854ade7971b7 owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:57.916271 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] Deleting port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:57.916271 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:57.924694 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2566d3f-d17c-49a7-92c4-8b94d64a1869 req-a713469a-a889-4751-974d-13a0e884d882 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:49:57.926278 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c2566d3f-d17c-49a7-92c4-8b94d64a1869 req-a713469a-a889-4751-974d-13a0e884d882 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 945 time: 0.0587776 Dec 09 14:49:57.956982 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4d2bd238-9f84-48d0-8d56-4fea03d0135e None None] DHCP port deletion for f0982548-601b-4206-88dc-a16a0317b421 request from dv-cinder-819692-8-iscsi {{(pid=109063) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 14:49:57.962796 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device c3bcca35-88a0-437e-a9e8-3bcbcd962647 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:49:57.995388 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c2566d3f-d17c-49a7-92c4-8b94d64a1869 req-854ece36-5fa5-4949-91e3-9033975bc662 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups?id=927687a4-aeb0-458e-b110-0ce356cf2037&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0617208 Dec 09 14:49:58.008751 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: c3bcca35-88a0-437e-a9e8-3bcbcd962647 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:49:58.009293 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device c3bcca35-88a0-437e-a9e8-3bcbcd962647 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:49:58.020269 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] For port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=8b6f9d9a-d11e-4ffb-bb62-128ad19cd496,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:58.020662 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:58.039494 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-4d2bd238-9f84-48d0-8d56-4fea03d0135e None None] Deleting port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 {{(pid=109063) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:58.040016 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4d2bd238-9f84-48d0-8d56-4fea03d0135e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:58.041395 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] Calling delete_port for 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 owned by network:dhcp {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:58.115513 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-4d2bd238-9f84-48d0-8d56-4fea03d0135e None None] For port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=8b6f9d9a-d11e-4ffb-bb62-128ad19cd496,segment=NetworkSegment(a2b92707-4465-4444-9285-42fd2c8881e1),segment_id=a2b92707-4465-4444-9285-42fd2c8881e1)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:58.116034 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4d2bd238-9f84-48d0-8d56-4fea03d0135e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:58.128660 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-4d2bd238-9f84-48d0-8d56-4fea03d0135e None None] Calling delete_port for 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 owned by network:dhcp {{(pid=109063) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:58.174277 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-0b8be6d7-68cb-4aa9-880a-fefb6e3bb37b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:58.176438 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:58.209293 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] Pushing event deleted for resources: {'Port': ['ID=8b6f9d9a-d11e-4ffb-bb62-128ad19cd496,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:58.214411 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4d2bd238-9f84-48d0-8d56-4fea03d0135e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959'] for port, after_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:58.217884 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] No DVR routers for this DVR port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 on host dv-cinder-819692-8-iscsi {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:49:58.244458 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b8be6d7-68cb-4aa9-880a-fefb6e3bb37b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event deleted for resources: {'Port': ['ID=aa786f00-e147-482f-b4af-854ade7971b7,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:58.251447 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d2bd238-9f84-48d0-8d56-4fea03d0135e None None] No DVR routers for this DVR port 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 on host dv-cinder-819692-8-iscsi {{(pid=109063) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:49:58.256430 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d2bd238-9f84-48d0-8d56-4fea03d0135e None None] Pushing event deleted for resources: {'Port': ['ID=8b6f9d9a-d11e-4ffb-bb62-128ad19cd496,revision_number=None']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:58.358411 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:58.409042 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f0982548-601b-4206-88dc-a16a0317b421']}} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:58.424795 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a2b92707-4465-4444-9285-42fd2c8881e1') {'for_net_delete': True} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:58.425091 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a2b92707-4465-4444-9285-42fd2c8881e1') {} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:58.437252 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1271949'] for segment, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:58.452608 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-0b8be6d7-68cb-4aa9-880a-fefb6e3bb37b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Router 55e9791c-df4d-4622-ba5c-87f71cd3c12b has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:49:58.453926 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:58.462156 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] Releasing vlan 449 on physical network physnet1 to pool {{(pid=109061) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:49:58.462416 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-133412129'] for segment, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: Traceback (most recent call last): Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: timer() Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: cb(*args, **kw) Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: return func(*args, **kwargs) Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: self._notify() Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: self.callback(batched_events) Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: event.method(event) Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: return f(self, *a, **k) Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._get(url).json() Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: return self.request(url, 'GET', **kwargs) Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:49:58.464095 dv-cinder-819692-8-iscsi neutron-server[109061]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:49:58.566672 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:58.862279 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:58.865383 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] 10.222.0.39 "DELETE /v2.0/networks/f0982548-601b-4206-88dc-a16a0317b421 HTTP/1.1" status: 204 len: 168 time: 1.2318873 Dec 09 14:49:58.868737 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60866) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:49:58.876085 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3344372e-a112-47af-bf1e-2fef4594f1ef admin admin] Pushing event deleted for resources: {'Network': ['ID=f0982548-601b-4206-88dc-a16a0317b421,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:58.899293 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-0b8be6d7-68cb-4aa9-880a-fefb6e3bb37b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:49:58.909154 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e44ecaa7-7e4d-4801-b54a-449f2070a8eb None None] Sync routers for ids ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:49:58.920100 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e44ecaa7-7e4d-4801-b54a-449f2070a8eb None None] Routers {'55e9791c-df4d-4622-ba5c-87f71cd3c12b'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:49:58.920999 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-e44ecaa7-7e4d-4801-b54a-449f2070a8eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:49:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:58.941339 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-0b8be6d7-68cb-4aa9-880a-fefb6e3bb37b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] No DVR routers for this DVR port aa786f00-e147-482f-b4af-854ade7971b7 on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:49:58.944141 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-0b8be6d7-68cb-4aa9-880a-fefb6e3bb37b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:58.948017 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c09ac555-633a-427a-ae30-58d34bc9c235 req-0b8be6d7-68cb-4aa9-880a-fefb6e3bb37b tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.44 "DELETE /v2.0/ports/aa786f00-e147-482f-b4af-854ade7971b7 HTTP/1.1" status: 204 len: 173 time: 1.5124907 Dec 09 14:49:58.948848 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '16803667-78ca-4e38-97ce-e51fa14c3825', 'name': 'network-vif-deleted', 'tag': 'aa786f00-e147-482f-b4af-854ade7971b7'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:49:58.954356 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-471c665b-4476-492f-a599-8bcf6fc9bfe6" -d '{"events": [{"server_uuid": "16803667-78ca-4e38-97ce-e51fa14c3825", "name": "network-vif-deleted", "tag": "aa786f00-e147-482f-b4af-854ade7971b7"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:49:59.005661 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:49:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f978c32c-cf28-47e9-ae73-5c4c5c5f820f x-openstack-request-id: req-f978c32c-cf28-47e9-ae73-5c4c5c5f820f {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:49:59.006022 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "16803667-78ca-4e38-97ce-e51fa14c3825", "name": "network-vif-deleted", "tag": "aa786f00-e147-482f-b4af-854ade7971b7", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:49:59.006342 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-f978c32c-cf28-47e9-ae73-5c4c5c5f820f {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:49:59.006806 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '16803667-78ca-4e38-97ce-e51fa14c3825', 'name': 'network-vif-deleted', 'tag': 'aa786f00-e147-482f-b4af-854ade7971b7', 'status': 'completed', 'code': 200} Dec 09 14:49:59.060370 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-e44ecaa7-7e4d-4801-b54a-449f2070a8eb None None] Set router 55e9791c-df4d-4622-ba5c-87f71cd3c12b gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:49:59.123283 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-59cc612b-0eae-4278-b725-bccb69a20453 req-10b9f1de-f455-4413-8c18-8d2fac06c8d3 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/ports?device_id=16803667-78ca-4e38-97ce-e51fa14c3825 HTTP/1.1" status: 200 len: 210 time: 0.0339220 Dec 09 14:49:59.188029 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-1fa4b6a8-e3bb-432b-82f5-083af12e96e6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:59.243041 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:49:59.264038 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:49:59.264770 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 8b6f9d9a-d11e-4ffb-bb62-128ad19cd496 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:49:59.265419 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device d811a33d-c420-4cb6-9ca9-cc0a9c770df5 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:49:59.267993 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-e44ecaa7-7e4d-4801-b54a-449f2070a8eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'ade23a8f-bc90-4df9-9f92-95d4b4587037', 'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'mac_address': 'fa:16:3e:65:b3:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 124, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:58Z', 'revision_number': 5, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'subnets': [{'id': '4b7e026c-4454-4200-91c3-30d27a976452', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:59.282096 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a82ce047-54a2-4d26-989d-366a614729a7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1629277'] for router_interface, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:59.284362 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: d811a33d-c420-4cb6-9ca9-cc0a9c770df5 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:49:59.284948 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device d811a33d-c420-4cb6-9ca9-cc0a9c770df5 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:49:59.297670 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e44ecaa7-7e4d-4801-b54a-449f2070a8eb None None] Checking router: 55e9791c-df4d-4622-ba5c-87f71cd3c12b for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:49:59.306054 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e44ecaa7-7e4d-4801-b54a-449f2070a8eb None None] Routers {'55e9791c-df4d-4622-ba5c-87f71cd3c12b'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:49:59.306712 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-e44ecaa7-7e4d-4801-b54a-449f2070a8eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:49:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:59.417636 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-e44ecaa7-7e4d-4801-b54a-449f2070a8eb None None] Set router 55e9791c-df4d-4622-ba5c-87f71cd3c12b gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:49:59.536286 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-a82ce047-54a2-4d26-989d-366a614729a7 admin admin] Deleting port 91495d3d-92f1-40a0-8137-14990e8f3b6f {{(pid=109062) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:49:59.536643 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a82ce047-54a2-4d26-989d-366a614729a7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:59.612538 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.db [None req-a82ce047-54a2-4d26-989d-366a614729a7 admin admin] For port 91495d3d-92f1-40a0-8137-14990e8f3b6f, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=91495d3d-92f1-40a0-8137-14990e8f3b6f,segment=NetworkSegment(5ff332d6-98f0-4e32-b597-ce3b7eef375d),segment_id=5ff332d6-98f0-4e32-b597-ce3b7eef375d)] {{(pid=109062) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:49:59.612993 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a82ce047-54a2-4d26-989d-366a614729a7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:59.620356 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-e44ecaa7-7e4d-4801-b54a-449f2070a8eb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'ade23a8f-bc90-4df9-9f92-95d4b4587037', 'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'mac_address': 'fa:16:3e:65:b3:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 124, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:58Z', 'revision_number': 5, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'subnets': [{'id': '4b7e026c-4454-4200-91c3-30d27a976452', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:49:59.629552 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-a82ce047-54a2-4d26-989d-366a614729a7 admin admin] Calling delete_port for 91495d3d-92f1-40a0-8137-14990e8f3b6f owned by network:router_interface {{(pid=109062) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:49:59.645963 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e44ecaa7-7e4d-4801-b54a-449f2070a8eb None None] The sync data for ids ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'] in dv-cinder-819692-8-iscsi is: [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 4, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'ade23a8f-bc90-4df9-9f92-95d4b4587037', 'name': '', 'network_id': '1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'mac_address': 'fa:16:3e:65:b3:12', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_interface', 'standard_attr_id': 124, 'fixed_ips': [{'subnet_id': '4b7e026c-4454-4200-91c3-30d27a976452', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:47Z', 'updated_at': '2021-12-09T14:42:58Z', 'revision_number': 5, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'subnets': [{'id': '4b7e026c-4454-4200-91c3-30d27a976452', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:49:59.811984 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a82ce047-54a2-4d26-989d-366a614729a7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:49:59.837840 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a82ce047-54a2-4d26-989d-366a614729a7 admin admin] Pushing event deleted for resources: {'Port': ['ID=91495d3d-92f1-40a0-8137-14990e8f3b6f,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:49:59.865857 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-86ea18a2-5a8f-4291-b164-157ba4b726d0 None None] New status for floating IP 8c911938-4c2f-4ad8-a14e-02e817758c6d: DOWN {{(pid=109063) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:50:00.003737 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a82ce047-54a2-4d26-989d-366a614729a7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2066028', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1629233'] for router_interface, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:00.215981 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60876) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:00.277277 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-76b5a7bf-a821-4f23-a620-eb3c79ad84d0 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:00.304242 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-76b5a7bf-a821-4f23-a620-eb3c79ad84d0 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:00.354031 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-76b5a7bf-a821-4f23-a620-eb3c79ad84d0 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:00.356889 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-76b5a7bf-a821-4f23-a620-eb3c79ad84d0 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:00.360568 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-76b5a7bf-a821-4f23-a620-eb3c79ad84d0 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "DELETE /v2.0/security-groups/927687a4-aeb0-458e-b110-0ce356cf2037 HTTP/1.1" status: 204 len: 168 time: 0.1410995 Dec 09 14:50:00.367472 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60878) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:00.368318 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76b5a7bf-a821-4f23-a620-eb3c79ad84d0 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=927687a4-aeb0-458e-b110-0ce356cf2037,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:00.387644 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.api.v2.resource [None req-561e8a8b-939f-4c3c-b2f1-13b0d10f1fd3 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] show failed (client error): The resource could not be found. Dec 09 14:50:00.392124 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-561e8a8b-939f-4c3c-b2f1-13b0d10f1fd3 tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "GET /v2.0/security-groups/927687a4-aeb0-458e-b110-0ce356cf2037 HTTP/1.1" status: 404 len: 347 time: 0.0192785 Dec 09 14:50:00.392864 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60880) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:00.441315 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:00.464751 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a82ce047-54a2-4d26-989d-366a614729a7 admin admin] Router 7ee633f5-6fc0-47fb-b142-36d2466f7abd has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:50:00.521374 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-49fc806c-5cd2-4f7e-8e60-c85cae26f51d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Deleting port f4928cda-04c2-49c8-bcd5-2edcf840d729 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:50:00.521719 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-49fc806c-5cd2-4f7e-8e60-c85cae26f51d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:00.569668 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a82ce047-54a2-4d26-989d-366a614729a7 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:50:00.576355 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-a82ce047-54a2-4d26-989d-366a614729a7 admin admin] 10.222.0.39 "PUT /v2.0/routers/7ee633f5-6fc0-47fb-b142-36d2466f7abd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7047591 Dec 09 14:50:00.577081 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60882) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:00.580200 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23ca0919-8f13-43f3-a165-50234ffb4f58 None None] Sync routers for ids ['7ee633f5-6fc0-47fb-b142-36d2466f7abd'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:50:00.592936 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23ca0919-8f13-43f3-a165-50234ffb4f58 None None] Routers {'7ee633f5-6fc0-47fb-b142-36d2466f7abd'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:00.593870 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-23ca0919-8f13-43f3-a165-50234ffb4f58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:49:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['7ee633f5-6fc0-47fb-b142-36d2466f7abd'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:00.602303 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-49fc806c-5cd2-4f7e-8e60-c85cae26f51d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:00.602900 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-49fc806c-5cd2-4f7e-8e60-c85cae26f51d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:00.614983 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-49fc806c-5cd2-4f7e-8e60-c85cae26f51d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Calling delete_port for f4928cda-04c2-49c8-bcd5-2edcf840d729 owned by network:floatingip {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:50:00.692516 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] Publish callbacks [] for router, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:00.717135 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-23ca0919-8f13-43f3-a165-50234ffb4f58 None None] Set router 7ee633f5-6fc0-47fb-b142-36d2466f7abd gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:00.780413 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-49fc806c-5cd2-4f7e-8e60-c85cae26f51d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:00.799311 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:00.831156 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49fc806c-5cd2-4f7e-8e60-c85cae26f51d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Pushing event deleted for resources: {'Port': ['ID=f4928cda-04c2-49c8-bcd5-2edcf840d729,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:00.867025 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] Deleting port 008db50f-29f1-4f8e-adfc-3ae8286f02d5 {{(pid=109062) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:50:00.867363 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:00.902715 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-49fc806c-5cd2-4f7e-8e60-c85cae26f51d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks [] for floatingip, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:00.905800 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-49fc806c-5cd2-4f7e-8e60-c85cae26f51d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:00.907986 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-49fc806c-5cd2-4f7e-8e60-c85cae26f51d tempest-AttachVolumeTestJSON-1712462208 tempest-AttachVolumeTestJSON-1712462208-project] 10.222.0.39 "DELETE /v2.0/floatingips/8c911938-4c2f-4ad8-a14e-02e817758c6d HTTP/1.1" status: 204 len: 168 time: 0.5137234 Dec 09 14:50:00.910358 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-23ca0919-8f13-43f3-a165-50234ffb4f58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'name': 'tempest-TestShelveInstance-1858903589-router', 'tenant_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.142'}], 'enable_snat': True}, 'gw_port_id': '008db50f-29f1-4f8e-adfc-3ae8286f02d5', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:59Z', 'updated_at': '2021-12-09T14:49:59Z', 'revision_number': 5, 'project_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'gw_port': {'id': '008db50f-29f1-4f8e-adfc-3ae8286f02d5', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:73:75:4a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 293, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.142', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:44:00Z', 'updated_at': '2021-12-09T14:44:07Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:01.004437 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.db [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] For port 008db50f-29f1-4f8e-adfc-3ae8286f02d5, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=008db50f-29f1-4f8e-adfc-3ae8286f02d5,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109062) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:01.011623 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:01.037730 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] Calling delete_port for 008db50f-29f1-4f8e-adfc-3ae8286f02d5 owned by network:router_gateway {{(pid=109062) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:50:01.051817 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23ca0919-8f13-43f3-a165-50234ffb4f58 None None] Checking router: 7ee633f5-6fc0-47fb-b142-36d2466f7abd for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:50:01.061867 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-23ca0919-8f13-43f3-a165-50234ffb4f58 None None] Routers {'7ee633f5-6fc0-47fb-b142-36d2466f7abd'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:01.062476 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-23ca0919-8f13-43f3-a165-50234ffb4f58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:49:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['7ee633f5-6fc0-47fb-b142-36d2466f7abd'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:01.150680 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-23ca0919-8f13-43f3-a165-50234ffb4f58 None None] Set router 7ee633f5-6fc0-47fb-b142-36d2466f7abd gateway port host: None {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:01.210908 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-23ca0919-8f13-43f3-a165-50234ffb4f58 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'name': 'tempest-TestShelveInstance-1858903589-router', 'tenant_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:59Z', 'updated_at': '2021-12-09T14:50:00Z', 'revision_number': 6, 'project_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'gw_port_host': None}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:01.217004 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:01.240962 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23ca0919-8f13-43f3-a165-50234ffb4f58 None None] The sync data for ids ['7ee633f5-6fc0-47fb-b142-36d2466f7abd'] in dv-cinder-819692-8-iscsi is: [{'id': '7ee633f5-6fc0-47fb-b142-36d2466f7abd', 'name': 'tempest-TestShelveInstance-1858903589-router', 'tenant_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:43:59Z', 'updated_at': '2021-12-09T14:50:00Z', 'revision_number': 6, 'project_id': 'a8f31f7e517c4112a4fe912ec0af4e73', 'gw_port_host': None}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:50:01.245939 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] Pushing event deleted for resources: {'Port': ['ID=008db50f-29f1-4f8e-adfc-3ae8286f02d5,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:01.319446 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1574291'] for router_gateway, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:01.360518 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device aa786f00-e147-482f-b4af-854ade7971b7 no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:50:01.380758 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: aa786f00-e147-482f-b4af-854ade7971b7 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:50:01.381108 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device aa786f00-e147-482f-b4af-854ade7971b7 not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:50:01.434179 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1626627', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30560'] for router, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:01.436306 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:01.513883 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1626682'] for router, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:01.514539 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7ee633f5-6fc0-47fb-b142-36d2466f7abd {{(pid=109062) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 14:50:01.520882 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] Publish callbacks [] for router, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:01.522078 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-e41b021e-6037-4b86-ac24-ec9d767bc125 admin admin] 10.222.0.39 "DELETE /v2.0/routers/7ee633f5-6fc0-47fb-b142-36d2466f7abd HTTP/1.1" status: 204 len: 168 time: 0.9440899 Dec 09 14:50:01.524629 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60888) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:01.573183 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_v2 [None req-76b30c4e-05d9-4651-bfc5-c5da61e5913a admin admin] Deleting subnet 63f5a977-675b-413c-a956-3d5e00291d6e {{(pid=109062) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:50:01.578087 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-76b30c4e-05d9-4651-bfc5-c5da61e5913a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:01.617132 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-76b30c4e-05d9-4651-bfc5-c5da61e5913a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-130415749'] for subnet, precommit_delete_associations {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:01.705348 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-76b30c4e-05d9-4651-bfc5-c5da61e5913a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:01.759332 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-76b30c4e-05d9-4651-bfc5-c5da61e5913a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-130461228', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-130768914'] for subnet, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:01.787120 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-76b30c4e-05d9-4651-bfc5-c5da61e5913a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:01.790513 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-76b30c4e-05d9-4651-bfc5-c5da61e5913a admin admin] 10.222.0.39 "DELETE /v2.0/subnets/63f5a977-675b-413c-a956-3d5e00291d6e HTTP/1.1" status: 204 len: 168 time: 0.2648747 Dec 09 14:50:01.791399 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76b30c4e-05d9-4651-bfc5-c5da61e5913a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=63f5a977-675b-413c-a956-3d5e00291d6e,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:01.792820 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-425c5835-6d32-4312-8fdf-0269f7503af6 None None] Network edca1021-fd9b-45bb-ba78-6e98cb142620 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:50:01.793540 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60890) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:01.862350 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:01.864825 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:01.919815 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] Deleting port 3e85441c-aef7-4129-abc7-1c08d1066a30 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:50:01.920192 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:01.976834 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2b74b91f-46ff-4f06-a047-30c5c0791de7 None None] DHCP port deletion for edca1021-fd9b-45bb-ba78-6e98cb142620 request from dv-cinder-819692-8-iscsi {{(pid=109063) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 14:50:01.986423 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] For port 3e85441c-aef7-4129-abc7-1c08d1066a30, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=3e85441c-aef7-4129-abc7-1c08d1066a30,segment=NetworkSegment(5ff332d6-98f0-4e32-b597-ce3b7eef375d),segment_id=5ff332d6-98f0-4e32-b597-ce3b7eef375d)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:01.986818 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.000310 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] Calling delete_port for 3e85441c-aef7-4129-abc7-1c08d1066a30 owned by network:dhcp {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:50:02.030222 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-2b74b91f-46ff-4f06-a047-30c5c0791de7 None None] Deleting port 3e85441c-aef7-4129-abc7-1c08d1066a30 {{(pid=109063) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:50:02.030588 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-2b74b91f-46ff-4f06-a047-30c5c0791de7 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.082829 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.094741 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-2b74b91f-46ff-4f06-a047-30c5c0791de7 None None] For port 3e85441c-aef7-4129-abc7-1c08d1066a30, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=3e85441c-aef7-4129-abc7-1c08d1066a30,segment=NetworkSegment(5ff332d6-98f0-4e32-b597-ce3b7eef375d),segment_id=5ff332d6-98f0-4e32-b597-ce3b7eef375d)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:02.095081 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-2b74b91f-46ff-4f06-a047-30c5c0791de7 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.109722 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-2b74b91f-46ff-4f06-a047-30c5c0791de7 None None] Calling delete_port for 3e85441c-aef7-4129-abc7-1c08d1066a30 owned by network:dhcp {{(pid=109063) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:50:02.115686 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] Pushing event deleted for resources: {'Port': ['ID=3e85441c-aef7-4129-abc7-1c08d1066a30,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:02.119063 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] No DVR routers for this DVR port 3e85441c-aef7-4129-abc7-1c08d1066a30 on host dv-cinder-819692-8-iscsi {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:50:02.196943 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.216216 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-2b74b91f-46ff-4f06-a047-30c5c0791de7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959'] for port, after_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.228729 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['edca1021-fd9b-45bb-ba78-6e98cb142620']}} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:02.230279 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5ff332d6-98f0-4e32-b597-ce3b7eef375d') {'for_net_delete': True} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:02.230582 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5ff332d6-98f0-4e32-b597-ce3b7eef375d') {} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:02.240350 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1271949'] for segment, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.248850 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b74b91f-46ff-4f06-a047-30c5c0791de7 None None] Pushing event deleted for resources: {'Port': ['ID=3e85441c-aef7-4129-abc7-1c08d1066a30,revision_number=None']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:02.250832 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b74b91f-46ff-4f06-a047-30c5c0791de7 None None] No DVR routers for this DVR port 3e85441c-aef7-4129-abc7-1c08d1066a30 on host dv-cinder-819692-8-iscsi {{(pid=109063) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:50:02.254770 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.265531 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] Releasing vlan 419 on physical network physnet1 to pool {{(pid=109061) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:50:02.265965 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-133412129'] for segment, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: Traceback (most recent call last): Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: timer() Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: cb(*args, **kw) Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: return func(*args, **kwargs) Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: self._notify() Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: self.callback(batched_events) Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: event.method(event) Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: return f(self, *a, **k) Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._get(url).json() Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: return self.request(url, 'GET', **kwargs) Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:50:02.268132 dv-cinder-819692-8-iscsi neutron-server[109061]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:50:02.334716 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.343077 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.346312 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] 10.222.0.39 "DELETE /v2.0/networks/edca1021-fd9b-45bb-ba78-6e98cb142620 HTTP/1.1" status: 204 len: 168 time: 0.5516205 Dec 09 14:50:02.357679 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e1b5b27-1dd2-4607-bda9-41903f7fde4e admin admin] Pushing event deleted for resources: {'Network': ['ID=edca1021-fd9b-45bb-ba78-6e98cb142620,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:02.462286 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60902) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:02.505948 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-30199a41-dc18-4bf0-bb55-06d8b0381b67 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=10d73d0acf44499e88f6d53847b2094e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0403383 Dec 09 14:50:02.506558 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60904) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:02.555355 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a710487b-9d1a-4e39-834b-774754ad114f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.590869 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a710487b-9d1a-4e39-834b-774754ad114f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.608866 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.643004 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a710487b-9d1a-4e39-834b-774754ad114f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.645762 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a710487b-9d1a-4e39-834b-774754ad114f admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:02.647507 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-a710487b-9d1a-4e39-834b-774754ad114f admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/18ffe91a-1656-4030-9b32-0fa66943ae07 HTTP/1.1" status: 204 len: 168 time: 0.1399846 Dec 09 14:50:02.655768 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a710487b-9d1a-4e39-834b-774754ad114f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=18ffe91a-1656-4030-9b32-0fa66943ae07,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:02.981258 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60910) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:03.024077 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-55e621df-75f9-4da6-8264-a601086f95e4 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=a8f31f7e517c4112a4fe912ec0af4e73&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0414832 Dec 09 14:50:03.026598 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60912) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:03.075311 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3ef49cfe-758b-4554-935b-a7e16de8c1dd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:03.097548 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3ef49cfe-758b-4554-935b-a7e16de8c1dd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:03.145879 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3ef49cfe-758b-4554-935b-a7e16de8c1dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:03.148484 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3ef49cfe-758b-4554-935b-a7e16de8c1dd admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:03.149650 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-3ef49cfe-758b-4554-935b-a7e16de8c1dd admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/64df9bd4-83c7-4f5b-9929-5705e5ed105a HTTP/1.1" status: 204 len: 168 time: 0.1220217 Dec 09 14:50:03.157721 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ef49cfe-758b-4554-935b-a7e16de8c1dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=64df9bd4-83c7-4f5b-9929-5705e5ed105a,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:03.235399 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 008db50f-29f1-4f8e-adfc-3ae8286f02d5 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:50:03.259889 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 008db50f-29f1-4f8e-adfc-3ae8286f02d5 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:50:03.260374 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 008db50f-29f1-4f8e-adfc-3ae8286f02d5 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:50:03.260800 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 91495d3d-92f1-40a0-8137-14990e8f3b6f no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:50:03.282249 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 91495d3d-92f1-40a0-8137-14990e8f3b6f {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:50:03.282755 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 91495d3d-92f1-40a0-8137-14990e8f3b6f not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:50:03.283359 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 3e85441c-aef7-4129-abc7-1c08d1066a30 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:50:03.304949 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 3e85441c-aef7-4129-abc7-1c08d1066a30 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:50:03.305297 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 3e85441c-aef7-4129-abc7-1c08d1066a30 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:50:03.939686 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e54cda5-9875-48aa-a94c-a3140e2005a2 req-f8135348-2c80-4038-970a-a41884f28517 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:03.941254 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8e54cda5-9875-48aa-a94c-a3140e2005a2 req-f8135348-2c80-4038-970a-a41884f28517 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 947 time: 0.0565979 Dec 09 14:50:03.991049 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8e54cda5-9875-48aa-a94c-a3140e2005a2 req-7a0f4496-5338-4b22-bb47-947e44eecc1e tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437331 Dec 09 14:50:04.537318 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60942) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:05.110445 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1629277'] for router_interface, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:05.113961 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d5a1f0-475b-45c1-b673-7161ad7f6e6f req-c8dc056f-2a5e-44b4-97dc-636692764f75 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:05.116388 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-99d5a1f0-475b-45c1-b673-7161ad7f6e6f req-c8dc056f-2a5e-44b4-97dc-636692764f75 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 947 time: 0.0517583 Dec 09 14:50:05.167467 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-99d5a1f0-475b-45c1-b673-7161ad7f6e6f req-56a25c34-d2e2-46f9-ad31-e8c7259107e3 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups?id=a6124e5d-ba62-478d-8349-5dc52bb5776b&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438716 Dec 09 14:50:05.321932 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-85aa0d8c-f52a-4769-9572-039f98feec57 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:05.323284 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-85aa0d8c-f52a-4769-9572-039f98feec57 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.44 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 947 time: 0.0626357 Dec 09 14:50:05.464028 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-6ae1f7a2-eb84-49c3-bc26-85e7e903d149 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Deleting port d37591e8-0953-4fbc-9688-71f4c813e43c {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:50:05.464377 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-6ae1f7a2-eb84-49c3-bc26-85e7e903d149 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:05.467840 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Deleting port ade23a8f-bc90-4df9-9f92-95d4b4587037 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:50:05.468159 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:05.610904 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-6ae1f7a2-eb84-49c3-bc26-85e7e903d149 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] For port d37591e8-0953-4fbc-9688-71f4c813e43c, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=d37591e8-0953-4fbc-9688-71f4c813e43c,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:05.611137 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-6ae1f7a2-eb84-49c3-bc26-85e7e903d149 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:05.614528 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] For port ade23a8f-bc90-4df9-9f92-95d4b4587037, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=ade23a8f-bc90-4df9-9f92-95d4b4587037,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:05.614903 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:05.635452 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Calling delete_port for ade23a8f-bc90-4df9-9f92-95d4b4587037 owned by network:router_interface {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:50:05.871711 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-6ae1f7a2-eb84-49c3-bc26-85e7e903d149 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:05.872008 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-6ae1f7a2-eb84-49c3-bc26-85e7e903d149 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:05.872326 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.l3_db [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-6ae1f7a2-eb84-49c3-bc26-85e7e903d149 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Floating IP 6a652206-bd32-429c-9f48-2defb12c69f0 disassociated. External IP: 172.27.0.254, port: d37591e8-0953-4fbc-9688-71f4c813e43c. Dec 09 14:50:05.872703 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-6ae1f7a2-eb84-49c3-bc26-85e7e903d149 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Calling delete_port for d37591e8-0953-4fbc-9688-71f4c813e43c owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:50:05.995561 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:06.045945 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Pushing event deleted for resources: {'Port': ['ID=ade23a8f-bc90-4df9-9f92-95d4b4587037,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:06.068803 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:06.069186 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:06.069524 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:06.069865 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:06.070170 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:06.070892 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:06.070892 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:06.071233 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:06.071487 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:06.071862 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:06.072190 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:06.072515 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:06.072838 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:06.115665 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-6ae1f7a2-eb84-49c3-bc26-85e7e903d149 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:06.150132 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ae1f7a2-eb84-49c3-bc26-85e7e903d149 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event deleted for resources: {'Port': ['ID=d37591e8-0953-4fbc-9688-71f4c813e43c,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:06.286719 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-17153d83-bafc-4baf-ad79-76afb50556d6 req-adfda050-2f51-4d9c-bbb3-d2e05f2c1b3c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 210 time: 0.0415623 Dec 09 14:50:06.369111 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2066028', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1629233'] for router_interface, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:06.381454 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-6ae1f7a2-eb84-49c3-bc26-85e7e903d149 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:50:06.871163 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-6ae1f7a2-eb84-49c3-bc26-85e7e903d149 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:50:06.881284 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ac8b85e-abb7-4ad3-82bc-2d632502d769 None None] Sync routers for ids ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:50:06.892269 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ac8b85e-abb7-4ad3-82bc-2d632502d769 None None] Routers {'49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:06.892874 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-1ac8b85e-abb7-4ad3-82bc-2d632502d769 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:49:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:06.943137 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-6ae1f7a2-eb84-49c3-bc26-85e7e903d149 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] No DVR routers for this DVR port d37591e8-0953-4fbc-9688-71f4c813e43c on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:50:06.946650 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-6ae1f7a2-eb84-49c3-bc26-85e7e903d149 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:06.949981 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-66a60710-dfdb-49ef-8614-b3a03385a605 req-6ae1f7a2-eb84-49c3-bc26-85e7e903d149 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.44 "DELETE /v2.0/ports/d37591e8-0953-4fbc-9688-71f4c813e43c HTTP/1.1" status: 204 len: 173 time: 1.6199133 Dec 09 14:50:06.950423 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '496052b6-9737-4680-bcd6-64721946b1a4', 'name': 'network-vif-deleted', 'tag': 'd37591e8-0953-4fbc-9688-71f4c813e43c'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:50:06.952721 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9043bd4d-67ea-42a8-b82d-251c2d8e1baf" -d '{"events": [{"server_uuid": "496052b6-9737-4680-bcd6-64721946b1a4", "name": "network-vif-deleted", "tag": "d37591e8-0953-4fbc-9688-71f4c813e43c"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:50:06.982558 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Router 55e9791c-df4d-4622-ba5c-87f71cd3c12b has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:50:07.003845 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-1ac8b85e-abb7-4ad3-82bc-2d632502d769 None None] Set router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:07.029864 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:50:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd3673f0-0ac4-4fd5-98c0-1dd63e5e9f5b x-openstack-request-id: req-bd3673f0-0ac4-4fd5-98c0-1dd63e5e9f5b {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:50:07.030142 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "496052b6-9737-4680-bcd6-64721946b1a4", "name": "network-vif-deleted", "tag": "d37591e8-0953-4fbc-9688-71f4c813e43c", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:50:07.030395 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-bd3673f0-0ac4-4fd5-98c0-1dd63e5e9f5b {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:50:07.030787 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '496052b6-9737-4680-bcd6-64721946b1a4', 'name': 'network-vif-deleted', 'tag': 'd37591e8-0953-4fbc-9688-71f4c813e43c', 'status': 'completed', 'code': 200} Dec 09 14:50:07.094359 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:50:07.102167 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-887f3288-ce84-4426-b034-37a52c9cd6f5 admin admin] 10.222.0.39 "PUT /v2.0/routers/55e9791c-df4d-4622-ba5c-87f71cd3c12b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5613925 Dec 09 14:50:07.102417 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60952) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:07.108256 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-110f587b-c95e-44cd-bc47-f2c95538cae1 None None] Sync routers for ids ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:50:07.119080 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-110f587b-c95e-44cd-bc47-f2c95538cae1 None None] Routers {'55e9791c-df4d-4622-ba5c-87f71cd3c12b'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:07.119485 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-110f587b-c95e-44cd-bc47-f2c95538cae1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:49:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:07.211057 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] Publish callbacks [] for router, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:07.226820 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-110f587b-c95e-44cd-bc47-f2c95538cae1 None None] Set router 55e9791c-df4d-4622-ba5c-87f71cd3c12b gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:07.249043 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-1ac8b85e-abb7-4ad3-82bc-2d632502d769 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '6db4124e-4bda-4bda-b604-9b9706732691', 'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'mac_address': 'fa:16:3e:7f:fb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 5, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'subnets': [{'id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:07.277423 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ac8b85e-abb7-4ad3-82bc-2d632502d769 None None] Checking router: 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:50:07.286349 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ac8b85e-abb7-4ad3-82bc-2d632502d769 None None] Routers {'49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:07.286977 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-1ac8b85e-abb7-4ad3-82bc-2d632502d769 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:49:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:07.320721 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:07.407098 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-1ac8b85e-abb7-4ad3-82bc-2d632502d769 None None] Set router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:07.427920 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-728fa106-1e22-49fb-a145-eb792e5df8fa req-8698b060-4603-4b80-92c4-4ced84c39311 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/ports?device_id=496052b6-9737-4680-bcd6-64721946b1a4 HTTP/1.1" status: 200 len: 210 time: 0.0508835 Dec 09 14:50:07.452832 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-110f587b-c95e-44cd-bc47-f2c95538cae1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107'}], 'enable_snat': True}, 'gw_port_id': '46ee0f4b-ef18-440f-a266-611402454855', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:50:05Z', 'revision_number': 5, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port': {'id': '46ee0f4b-ef18-440f-a266-611402454855', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:a3:5b:80', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 94, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.107', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:07.454669 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] Deleting port 46ee0f4b-ef18-440f-a266-611402454855 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:50:07.455020 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:07.487515 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-110f587b-c95e-44cd-bc47-f2c95538cae1 None None] Checking router: 55e9791c-df4d-4622-ba5c-87f71cd3c12b for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:50:07.496910 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-110f587b-c95e-44cd-bc47-f2c95538cae1 None None] Routers {'55e9791c-df4d-4622-ba5c-87f71cd3c12b'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:07.497813 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-110f587b-c95e-44cd-bc47-f2c95538cae1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:49:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:07.551790 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] For port 46ee0f4b-ef18-440f-a266-611402454855, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=46ee0f4b-ef18-440f-a266-611402454855,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:07.552309 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:07.564783 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] Calling delete_port for 46ee0f4b-ef18-440f-a266-611402454855 owned by network:router_gateway {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:50:07.591396 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-110f587b-c95e-44cd-bc47-f2c95538cae1 None None] Set router 55e9791c-df4d-4622-ba5c-87f71cd3c12b gateway port host: None {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:07.620218 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-1ac8b85e-abb7-4ad3-82bc-2d632502d769 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '6db4124e-4bda-4bda-b604-9b9706732691', 'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'mac_address': 'fa:16:3e:7f:fb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 5, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'subnets': [{'id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:07.645095 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-110f587b-c95e-44cd-bc47-f2c95538cae1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:50:07Z', 'revision_number': 6, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port_host': None}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:07.649866 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1ac8b85e-abb7-4ad3-82bc-2d632502d769 None None] The sync data for ids ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'] in dv-cinder-819692-8-iscsi is: [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:42:40Z', 'revision_number': 4, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '6db4124e-4bda-4bda-b604-9b9706732691', 'name': '', 'network_id': '9ab3f8b6-44d0-4210-907d-0e96072c4566', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'mac_address': 'fa:16:3e:7f:fb:db', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_interface', 'standard_attr_id': 93, 'fixed_ips': [{'subnet_id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:38Z', 'updated_at': '2021-12-09T14:42:50Z', 'revision_number': 5, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'subnets': [{'id': 'f10f1097-5d43-4737-bcac-a27ade66b442', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:50:07.675676 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-110f587b-c95e-44cd-bc47-f2c95538cae1 None None] The sync data for ids ['55e9791c-df4d-4622-ba5c-87f71cd3c12b'] in dv-cinder-819692-8-iscsi is: [{'id': '55e9791c-df4d-4622-ba5c-87f71cd3c12b', 'name': 'tempest-AttachVolumeTestJSON-806346136-router', 'tenant_id': 'a538bf01cb5440ffa06b6873f212efaa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:36Z', 'updated_at': '2021-12-09T14:50:07Z', 'revision_number': 6, 'project_id': 'a538bf01cb5440ffa06b6873f212efaa', 'gw_port_host': None}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:50:07.750706 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:07.776799 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] Pushing event deleted for resources: {'Port': ['ID=46ee0f4b-ef18-440f-a266-611402454855,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:07.839808 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1574291'] for router_gateway, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:07.884501 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8ff5d84e-603e-4ed0-b92d-a73908593fdf None None] New status for floating IP 6a652206-bd32-429c-9f48-2defb12c69f0: DOWN {{(pid=109063) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:50:07.934113 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1626627', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30560'] for router, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:07.936387 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:07.980941 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1626682'] for router, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:07.981326 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 55e9791c-df4d-4622-ba5c-87f71cd3c12b {{(pid=109061) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 14:50:07.985745 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:07.986942 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-5827386e-0daf-4440-99ff-bc05f7e257f4 admin admin] 10.222.0.39 "DELETE /v2.0/routers/55e9791c-df4d-4622-ba5c-87f71cd3c12b HTTP/1.1" status: 204 len: 168 time: 0.8834317 Dec 09 14:50:07.989620 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60956) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:08.040018 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_v2 [None req-c8610967-b442-4388-8432-d4d1e5008a8a admin admin] Deleting subnet 4b7e026c-4454-4200-91c3-30d27a976452 {{(pid=109061) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:50:08.043871 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8610967-b442-4388-8432-d4d1e5008a8a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.080436 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8610967-b442-4388-8432-d4d1e5008a8a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1271942'] for subnet, precommit_delete_associations {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.161772 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8610967-b442-4388-8432-d4d1e5008a8a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.215434 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8610967-b442-4388-8432-d4d1e5008a8a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-133412315', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-133640812'] for subnet, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.239497 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8610967-b442-4388-8432-d4d1e5008a8a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4b7e026c-4454-4200-91c3-30d27a976452,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:08.243136 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8610967-b442-4388-8432-d4d1e5008a8a admin admin] Publish callbacks [] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.246728 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-c8610967-b442-4388-8432-d4d1e5008a8a admin admin] 10.222.0.39 "DELETE /v2.0/subnets/4b7e026c-4454-4200-91c3-30d27a976452 HTTP/1.1" status: 204 len: 168 time: 0.2554619 Dec 09 14:50:08.249494 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60958) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:08.249704 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b023358c-a09e-4923-bfbe-3f5b0c6a9d43 None None] Network 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:50:08.320695 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.374521 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] Deleting port c5033ada-1e97-420a-a22d-70c7b1b64073 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:50:08.374811 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.442302 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] For port c5033ada-1e97-420a-a22d-70c7b1b64073, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=c5033ada-1e97-420a-a22d-70c7b1b64073,segment=NetworkSegment(249aca58-f120-4349-ac3d-e3bc6b709d78),segment_id=249aca58-f120-4349-ac3d-e3bc6b709d78)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:08.442302 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.449410 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1e2c8cb2-a247-4402-a767-f3c2e008c1e6 None None] DHCP port deletion for 1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b request from dv-cinder-819692-8-iscsi {{(pid=109063) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 14:50:08.461091 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] Calling delete_port for c5033ada-1e97-420a-a22d-70c7b1b64073 owned by network:dhcp {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:50:08.524003 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60964) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:08.568819 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.586913 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-65d2d27b-f6d7-41d0-ae51-172f45cff3d0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.599307 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] No DVR routers for this DVR port c5033ada-1e97-420a-a22d-70c7b1b64073 on host dv-cinder-819692-8-iscsi {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:50:08.605809 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] Pushing event deleted for resources: {'Port': ['ID=c5033ada-1e97-420a-a22d-70c7b1b64073,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:08.619049 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-65d2d27b-f6d7-41d0-ae51-172f45cff3d0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.651853 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-1e2c8cb2-a247-4402-a767-f3c2e008c1e6 None None] Deleting port c5033ada-1e97-420a-a22d-70c7b1b64073 {{(pid=109063) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:50:08.652236 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-1e2c8cb2-a247-4402-a767-f3c2e008c1e6 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.680948 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-65d2d27b-f6d7-41d0-ae51-172f45cff3d0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.683751 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-65d2d27b-f6d7-41d0-ae51-172f45cff3d0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.683886 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.684910 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-65d2d27b-f6d7-41d0-ae51-172f45cff3d0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "DELETE /v2.0/security-groups/a6124e5d-ba62-478d-8349-5dc52bb5776b HTTP/1.1" status: 204 len: 168 time: 0.1597459 Dec 09 14:50:08.688793 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60966) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:08.707234 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65d2d27b-f6d7-41d0-ae51-172f45cff3d0 tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a6124e5d-ba62-478d-8349-5dc52bb5776b,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:08.711930 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.api.v2.resource [None req-00ab8dce-f042-412e-b361-bcd48689b50c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] show failed (client error): The resource could not be found. Dec 09 14:50:08.715264 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-00ab8dce-f042-412e-b361-bcd48689b50c tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "GET /v2.0/security-groups/a6124e5d-ba62-478d-8349-5dc52bb5776b HTTP/1.1" status: 404 len: 347 time: 0.0252442 Dec 09 14:50:08.716567 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b']}} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:08.718872 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60968) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:08.740716 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-1e2c8cb2-a247-4402-a767-f3c2e008c1e6 None None] For port c5033ada-1e97-420a-a22d-70c7b1b64073, host dv-cinder-819692-8-iscsi, got binding levels [] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:08.741382 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-1e2c8cb2-a247-4402-a767-f3c2e008c1e6 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.761723 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '249aca58-f120-4349-ac3d-e3bc6b709d78') {'for_net_delete': True} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:08.761948 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-1e2c8cb2-a247-4402-a767-f3c2e008c1e6 None None] Calling delete_port for c5033ada-1e97-420a-a22d-70c7b1b64073 owned by network:dhcp {{(pid=109063) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:50:08.762047 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '249aca58-f120-4349-ac3d-e3bc6b709d78') {} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:08.764904 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.ipam_backend_mixin [None req-1e2c8cb2-a247-4402-a767-f3c2e008c1e6 None None] Port c5033ada-1e97-420a-a22d-70c7b1b64073 was not found and therefore no delete operation was performed {{(pid=109063) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 14:50:08.766142 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-1e2c8cb2-a247-4402-a767-f3c2e008c1e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959'] for port, after_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.776330 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1271949'] for segment, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.795098 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e2c8cb2-a247-4402-a767-f3c2e008c1e6 None None] Pushing event deleted for resources: {'Port': ['ID=c5033ada-1e97-420a-a22d-70c7b1b64073,revision_number=None']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:08.798635 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1e2c8cb2-a247-4402-a767-f3c2e008c1e6 None None] No DVR routers for this DVR port c5033ada-1e97-420a-a22d-70c7b1b64073 on host dv-cinder-819692-8-iscsi {{(pid=109063) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:50:08.832543 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.855318 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] Releasing vlan 442 on physical network physnet1 to pool {{(pid=109061) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:50:08.855710 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-133412129'] for segment, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: Traceback (most recent call last): Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: timer() Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: cb(*args, **kw) Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: return func(*args, **kwargs) Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: self._notify() Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: self.callback(batched_events) Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: event.method(event) Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: return f(self, *a, **k) Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._get(url).json() Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: return self.request(url, 'GET', **kwargs) Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:50:08.857728 dv-cinder-819692-8-iscsi neutron-server[109061]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:50:08.920637 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.925162 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.928366 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] 10.222.0.39 "DELETE /v2.0/networks/1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b HTTP/1.1" status: 204 len: 168 time: 0.6778300 Dec 09 14:50:08.944403 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-131ce482-2e8c-4e6e-b9a6-ca1199f5386b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Deleting port 4d79fcac-a2ad-4d97-a6bc-48df80cd54bf {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:50:08.944743 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-131ce482-2e8c-4e6e-b9a6-ca1199f5386b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:08.946620 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bce2f7b7-1713-4751-af05-e607f54155d6 admin admin] Pushing event deleted for resources: {'Network': ['ID=1f293eb6-c0cd-4cab-ba3f-c219b9b94c9b,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:09.026681 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-131ce482-2e8c-4e6e-b9a6-ca1199f5386b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:09.027053 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-131ce482-2e8c-4e6e-b9a6-ca1199f5386b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:09.038785 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-131ce482-2e8c-4e6e-b9a6-ca1199f5386b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Calling delete_port for 4d79fcac-a2ad-4d97-a6bc-48df80cd54bf owned by network:floatingip {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:50:09.044504 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 60972) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:09.083790 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-d148fbef-6c42-4be2-8834-9e3c2aa39294 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=a538bf01cb5440ffa06b6873f212efaa&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0379796 Dec 09 14:50:09.086264 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 60974) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:09.163477 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-78fa5698-3463-49ae-b86e-36517ca05852 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:09.205589 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-78fa5698-3463-49ae-b86e-36517ca05852 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:09.229159 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 46ee0f4b-ef18-440f-a266-611402454855 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:50:09.247690 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-131ce482-2e8c-4e6e-b9a6-ca1199f5386b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:09.250219 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 46ee0f4b-ef18-440f-a266-611402454855 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:50:09.250571 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 46ee0f4b-ef18-440f-a266-611402454855 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:50:09.251014 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device ade23a8f-bc90-4df9-9f92-95d4b4587037 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:50:09.271192 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: ade23a8f-bc90-4df9-9f92-95d4b4587037 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:50:09.271497 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device ade23a8f-bc90-4df9-9f92-95d4b4587037 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:50:09.271960 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device c5033ada-1e97-420a-a22d-70c7b1b64073 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:50:09.277549 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-131ce482-2e8c-4e6e-b9a6-ca1199f5386b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Pushing event deleted for resources: {'Port': ['ID=4d79fcac-a2ad-4d97-a6bc-48df80cd54bf,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:09.291194 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: c5033ada-1e97-420a-a22d-70c7b1b64073 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:50:09.291570 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device c5033ada-1e97-420a-a22d-70c7b1b64073 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:50:09.327663 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-78fa5698-3463-49ae-b86e-36517ca05852 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:09.330188 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-78fa5698-3463-49ae-b86e-36517ca05852 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:09.331318 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-78fa5698-3463-49ae-b86e-36517ca05852 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/01637d6a-d569-45c3-9f77-09d5026bf53c HTTP/1.1" status: 204 len: 168 time: 0.2441621 Dec 09 14:50:09.343041 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78fa5698-3463-49ae-b86e-36517ca05852 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=01637d6a-d569-45c3-9f77-09d5026bf53c,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:09.358190 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-131ce482-2e8c-4e6e-b9a6-ca1199f5386b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks [] for floatingip, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:09.360835 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-131ce482-2e8c-4e6e-b9a6-ca1199f5386b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:09.364776 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-131ce482-2e8c-4e6e-b9a6-ca1199f5386b tempest-AttachVolumeShelveTestJSON-278864093 tempest-AttachVolumeShelveTestJSON-278864093-project] 10.222.0.39 "DELETE /v2.0/floatingips/6a652206-bd32-429c-9f48-2defb12c69f0 HTTP/1.1" status: 204 len: 168 time: 0.6421010 Dec 09 14:50:09.389080 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device d37591e8-0953-4fbc-9688-71f4c813e43c no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:50:09.409890 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: d37591e8-0953-4fbc-9688-71f4c813e43c {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:50:09.410238 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device d37591e8-0953-4fbc-9688-71f4c813e43c not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:50:11.784890 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 32814) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:12.311848 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-31fb5269-dee3-4921-9840-542729df7a4e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1629277'] for router_interface, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:12.575737 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-31fb5269-dee3-4921-9840-542729df7a4e admin admin] Deleting port 6db4124e-4bda-4bda-b604-9b9706732691 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:50:12.575954 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-31fb5269-dee3-4921-9840-542729df7a4e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:12.661999 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-31fb5269-dee3-4921-9840-542729df7a4e admin admin] For port 6db4124e-4bda-4bda-b604-9b9706732691, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=6db4124e-4bda-4bda-b604-9b9706732691,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:12.662370 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-31fb5269-dee3-4921-9840-542729df7a4e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:12.675136 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-31fb5269-dee3-4921-9840-542729df7a4e admin admin] Calling delete_port for 6db4124e-4bda-4bda-b604-9b9706732691 owned by network:router_interface {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:50:12.867125 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-31fb5269-dee3-4921-9840-542729df7a4e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:12.895151 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31fb5269-dee3-4921-9840-542729df7a4e admin admin] Pushing event deleted for resources: {'Port': ['ID=6db4124e-4bda-4bda-b604-9b9706732691,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:12.986542 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 32826) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:13.066993 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-31fb5269-dee3-4921-9840-542729df7a4e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2066028', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1629233'] for router_interface, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:13.106596 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-eb0e0ca0-5065-46bd-9d7c-7f79e27f563a admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:13.189879 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-eb0e0ca0-5065-46bd-9d7c-7f79e27f563a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:13.197940 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-eb0e0ca0-5065-46bd-9d7c-7f79e27f563a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:13.236444 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb0e0ca0-5065-46bd-9d7c-7f79e27f563a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe8376cc-372e-4c7b-880c-3835e8411aa9,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:13.242412 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-eb0e0ca0-5065-46bd-9d7c-7f79e27f563a admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=1c4c44a2ba0043fa9e4abc2f88ae3b32&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2546067 Dec 09 14:50:13.245631 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 32830) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:13.297998 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5ca87d73-3215-4ae6-b371-16328138ae6c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:13.320431 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5ca87d73-3215-4ae6-b371-16328138ae6c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:13.373778 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5ca87d73-3215-4ae6-b371-16328138ae6c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:13.376786 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5ca87d73-3215-4ae6-b371-16328138ae6c admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:13.377978 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-5ca87d73-3215-4ae6-b371-16328138ae6c admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/fe8376cc-372e-4c7b-880c-3835e8411aa9 HTTP/1.1" status: 204 len: 168 time: 0.1314492 Dec 09 14:50:13.386206 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ca87d73-3215-4ae6-b371-16328138ae6c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe8376cc-372e-4c7b-880c-3835e8411aa9,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:13.441046 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:50:13.583931 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-31fb5269-dee3-4921-9840-542729df7a4e admin admin] Router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:50:13.690471 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31fb5269-dee3-4921-9840-542729df7a4e admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:50:13.698464 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-31fb5269-dee3-4921-9840-542729df7a4e admin admin] 10.222.0.39 "PUT /v2.0/routers/49df80d9-d5b4-4bb2-9772-8fb6fc15bcff/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9124041 Dec 09 14:50:13.698737 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 32842) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:13.701199 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9aab299-4991-40de-ba73-b58a67d48f3e None None] Sync routers for ids ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:50:13.713328 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9aab299-4991-40de-ba73-b58a67d48f3e None None] Routers {'49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:13.714123 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-e9aab299-4991-40de-ba73-b58a67d48f3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:49:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:13.817766 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] Publish callbacks [] for router, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:13.822473 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-e9aab299-4991-40de-ba73-b58a67d48f3e None None] Set router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:13.930992 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:13.986446 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] Deleting port 1a62fbb4-9280-496c-b60d-bf0b4423d01c {{(pid=109062) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:50:13.986785 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:14.002340 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-e9aab299-4991-40de-ba73-b58a67d48f3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19'}], 'enable_snat': True}, 'gw_port_id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:50:12Z', 'revision_number': 5, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port': {'id': '1a62fbb4-9280-496c-b60d-bf0b4423d01c', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:09:5d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'device_owner': 'network:router_gateway', 'standard_attr_id': 69, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.19', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:42:34Z', 'updated_at': '2021-12-09T14:42:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:14.028328 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9aab299-4991-40de-ba73-b58a67d48f3e None None] Checking router: 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:50:14.037178 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e9aab299-4991-40de-ba73-b58a67d48f3e None None] Routers {'49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:14.037825 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-e9aab299-4991-40de-ba73-b58a67d48f3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:49:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:14.074585 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.db [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] For port 1a62fbb4-9280-496c-b60d-bf0b4423d01c, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=1a62fbb4-9280-496c-b60d-bf0b4423d01c,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109062) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:14.074992 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:14.093406 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] Calling delete_port for 1a62fbb4-9280-496c-b60d-bf0b4423d01c owned by network:router_gateway {{(pid=109062) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:50:14.123362 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-e9aab299-4991-40de-ba73-b58a67d48f3e None None] Set router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff gateway port host: None {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:14.274352 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-e9aab299-4991-40de-ba73-b58a67d48f3e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:50:13Z', 'revision_number': 6, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port_host': None}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:14.276056 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:14.301988 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] Pushing event deleted for resources: {'Port': ['ID=1a62fbb4-9280-496c-b60d-bf0b4423d01c,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:14.302269 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e9aab299-4991-40de-ba73-b58a67d48f3e None None] The sync data for ids ['49df80d9-d5b4-4bb2-9772-8fb6fc15bcff'] in dv-cinder-819692-8-iscsi is: [{'id': '49df80d9-d5b4-4bb2-9772-8fb6fc15bcff', 'name': 'tempest-AttachVolumeShelveTestJSON-360714841-router', 'tenant_id': '6be5d78d2d0049448c3947b4e650758a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:42:33Z', 'updated_at': '2021-12-09T14:50:13Z', 'revision_number': 6, 'project_id': '6be5d78d2d0049448c3947b4e650758a', 'gw_port_host': None}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:50:14.370234 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1574291'] for router_gateway, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:14.462104 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1626627', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30560'] for router, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:14.464441 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:14.511293 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1626682'] for router, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:14.511988 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 49df80d9-d5b4-4bb2-9772-8fb6fc15bcff {{(pid=109062) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 14:50:14.517357 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] Publish callbacks [] for router, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:14.521218 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-8bcbe68c-92c2-4cd4-85bd-f77a12b50747 admin admin] 10.222.0.39 "DELETE /v2.0/routers/49df80d9-d5b4-4bb2-9772-8fb6fc15bcff HTTP/1.1" status: 204 len: 168 time: 0.8183866 Dec 09 14:50:14.521218 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 32868) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:14.568190 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_v2 [None req-ebaaf076-1c93-4ada-91be-ec7ed0dcf2a8 admin admin] Deleting subnet f10f1097-5d43-4737-bcac-a27ade66b442 {{(pid=109062) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:50:14.571438 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ebaaf076-1c93-4ada-91be-ec7ed0dcf2a8 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:14.610685 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ebaaf076-1c93-4ada-91be-ec7ed0dcf2a8 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-130415749'] for subnet, precommit_delete_associations {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:14.695886 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ebaaf076-1c93-4ada-91be-ec7ed0dcf2a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:14.759818 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ebaaf076-1c93-4ada-91be-ec7ed0dcf2a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-130461228', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-130768914'] for subnet, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:14.783911 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebaaf076-1c93-4ada-91be-ec7ed0dcf2a8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=f10f1097-5d43-4737-bcac-a27ade66b442,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:14.790284 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ebaaf076-1c93-4ada-91be-ec7ed0dcf2a8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:14.795437 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-ebaaf076-1c93-4ada-91be-ec7ed0dcf2a8 admin admin] 10.222.0.39 "DELETE /v2.0/subnets/f10f1097-5d43-4737-bcac-a27ade66b442 HTTP/1.1" status: 204 len: 168 time: 0.2707803 Dec 09 14:50:14.795957 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 32876) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:14.796442 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8b7e892c-6d71-4550-a497-4bc6d8600fbb None None] Network 9ab3f8b6-44d0-4210-907d-0e96072c4566 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:50:14.864601 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:14.889412 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:14.952508 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] Deleting port ee4e8552-9104-4bc3-a43c-493419d282a1 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:50:14.952858 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.020117 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] For port ee4e8552-9104-4bc3-a43c-493419d282a1, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=ee4e8552-9104-4bc3-a43c-493419d282a1,segment=NetworkSegment(1adee164-28a6-4213-83dc-d46a3aca10ed),segment_id=1adee164-28a6-4213-83dc-d46a3aca10ed)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:15.020500 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.034310 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] Calling delete_port for ee4e8552-9104-4bc3-a43c-493419d282a1 owned by network:dhcp {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:50:15.101252 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6cf2eb6-3c5b-4653-8746-fb27f32ae8c2 None None] DHCP port deletion for 9ab3f8b6-44d0-4210-907d-0e96072c4566 request from dv-cinder-819692-8-iscsi {{(pid=109063) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 14:50:15.125553 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.156000 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-c6cf2eb6-3c5b-4653-8746-fb27f32ae8c2 None None] Deleting port ee4e8552-9104-4bc3-a43c-493419d282a1 {{(pid=109063) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:50:15.156637 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-c6cf2eb6-3c5b-4653-8746-fb27f32ae8c2 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.157674 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] Pushing event deleted for resources: {'Port': ['ID=ee4e8552-9104-4bc3-a43c-493419d282a1,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:15.162220 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] No DVR routers for this DVR port ee4e8552-9104-4bc3-a43c-493419d282a1 on host dv-cinder-819692-8-iscsi {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:50:15.247887 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-c6cf2eb6-3c5b-4653-8746-fb27f32ae8c2 None None] For port ee4e8552-9104-4bc3-a43c-493419d282a1, host dv-cinder-819692-8-iscsi, got binding levels [] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:15.247887 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-c6cf2eb6-3c5b-4653-8746-fb27f32ae8c2 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.248111 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.268960 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-c6cf2eb6-3c5b-4653-8746-fb27f32ae8c2 None None] Calling delete_port for ee4e8552-9104-4bc3-a43c-493419d282a1 owned by network:dhcp {{(pid=109063) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:50:15.272943 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.ipam_backend_mixin [None req-c6cf2eb6-3c5b-4653-8746-fb27f32ae8c2 None None] Port ee4e8552-9104-4bc3-a43c-493419d282a1 was not found and therefore no delete operation was performed {{(pid=109063) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Dec 09 14:50:15.274230 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-c6cf2eb6-3c5b-4653-8746-fb27f32ae8c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959'] for port, after_delete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.295223 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9ab3f8b6-44d0-4210-907d-0e96072c4566']}} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:15.306252 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1adee164-28a6-4213-83dc-d46a3aca10ed') {'for_net_delete': True} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:15.306611 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1adee164-28a6-4213-83dc-d46a3aca10ed') {} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:15.309843 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 6db4124e-4bda-4bda-b604-9b9706732691 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:50:15.313339 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6cf2eb6-3c5b-4653-8746-fb27f32ae8c2 None None] Pushing event deleted for resources: {'Port': ['ID=ee4e8552-9104-4bc3-a43c-493419d282a1,revision_number=None']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:15.319556 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1271949'] for segment, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.337178 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c6cf2eb6-3c5b-4653-8746-fb27f32ae8c2 None None] No DVR routers for this DVR port ee4e8552-9104-4bc3-a43c-493419d282a1 on host dv-cinder-819692-8-iscsi {{(pid=109063) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:50:15.338660 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 6db4124e-4bda-4bda-b604-9b9706732691 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:50:15.339007 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 6db4124e-4bda-4bda-b604-9b9706732691 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:50:15.339415 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 1a62fbb4-9280-496c-b60d-bf0b4423d01c no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:50:15.340667 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.351465 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] Releasing vlan 412 on physical network physnet1 to pool {{(pid=109061) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:50:15.351988 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-133412129'] for segment, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: Traceback (most recent call last): Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: timer() Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: cb(*args, **kw) Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: return func(*args, **kwargs) Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: self._notify() Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: self.callback(batched_events) Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: event.method(event) Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: return f(self, *a, **k) Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._get(url).json() Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: return self.request(url, 'GET', **kwargs) Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:50:15.353961 dv-cinder-819692-8-iscsi neutron-server[109061]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:50:15.362624 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 1a62fbb4-9280-496c-b60d-bf0b4423d01c {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:50:15.362975 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 1a62fbb4-9280-496c-b60d-bf0b4423d01c not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:50:15.363395 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device ee4e8552-9104-4bc3-a43c-493419d282a1 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:50:15.388542 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: ee4e8552-9104-4bc3-a43c-493419d282a1 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:50:15.389132 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device ee4e8552-9104-4bc3-a43c-493419d282a1 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:50:15.429782 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.434816 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.438787 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] 10.222.0.39 "DELETE /v2.0/networks/9ab3f8b6-44d0-4210-907d-0e96072c4566 HTTP/1.1" status: 204 len: 168 time: 0.6415539 Dec 09 14:50:15.453962 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-adcddd63-f63b-4f37-9d10-34897c378b81 admin admin] Pushing event deleted for resources: {'Network': ['ID=9ab3f8b6-44d0-4210-907d-0e96072c4566,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:15.630186 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 32922) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:15.674756 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-b5ae0a17-b9a1-4c9b-ac18-b58680b11035 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=6be5d78d2d0049448c3947b4e650758a&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0409558 Dec 09 14:50:15.675090 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 32930) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:15.728692 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-321fb878-7ef1-4db3-a4e6-b9f7e793e20b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.755596 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-321fb878-7ef1-4db3-a4e6-b9f7e793e20b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.805030 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-321fb878-7ef1-4db3-a4e6-b9f7e793e20b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.807842 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-321fb878-7ef1-4db3-a4e6-b9f7e793e20b admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:15.809357 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-321fb878-7ef1-4db3-a4e6-b9f7e793e20b admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/84982077-48d6-4c41-b24d-f6a4e065606c HTTP/1.1" status: 204 len: 168 time: 0.1334400 Dec 09 14:50:15.818555 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-321fb878-7ef1-4db3-a4e6-b9f7e793e20b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=84982077-48d6-4c41-b24d-f6a4e065606c,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:16.454083 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 32992) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:16.653304 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-285baed0-6432-42ff-adba-15cfb874f573 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:16.734431 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-285baed0-6432-42ff-adba-15cfb874f573 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:16.740019 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-285baed0-6432-42ff-adba-15cfb874f573 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:16.780149 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-285baed0-6432-42ff-adba-15cfb874f573 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=b26aac81bf2242f99f2b8f97e380c8f1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3247716 Dec 09 14:50:16.782963 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33002) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:16.783979 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-285baed0-6432-42ff-adba-15cfb874f573 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f4d86d1-341d-4984-89ea-c225c6c9ec63,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:16.838976 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-73d099a5-0926-4ec1-9750-6d9c7fc095a1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:16.861085 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-73d099a5-0926-4ec1-9750-6d9c7fc095a1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:16.909789 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-73d099a5-0926-4ec1-9750-6d9c7fc095a1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:16.913202 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-73d099a5-0926-4ec1-9750-6d9c7fc095a1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:16.914413 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-73d099a5-0926-4ec1-9750-6d9c7fc095a1 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/3f4d86d1-341d-4984-89ea-c225c6c9ec63 HTTP/1.1" status: 204 len: 168 time: 0.1302512 Dec 09 14:50:16.922760 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73d099a5-0926-4ec1-9750-6d9c7fc095a1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f4d86d1-341d-4984-89ea-c225c6c9ec63,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:17.244002 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33022) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:17.257809 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c4c31aab-6496-4eee-9c12-ff687952f4ef admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:17.332049 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c4c31aab-6496-4eee-9c12-ff687952f4ef admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:17.337335 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-c4c31aab-6496-4eee-9c12-ff687952f4ef admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:17.379374 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-c4c31aab-6496-4eee-9c12-ff687952f4ef admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=96a8cd485c344adba7dd99a48bd860cb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1342266 Dec 09 14:50:17.380263 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4c31aab-6496-4eee-9c12-ff687952f4ef admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd1cb161-115f-4b95-8f4b-b6fe28feeecd,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:17.382053 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33032) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:17.432196 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8950924-9a17-4072-a1a3-84a8ccf9cbe0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:17.453622 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8950924-9a17-4072-a1a3-84a8ccf9cbe0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:17.506870 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8950924-9a17-4072-a1a3-84a8ccf9cbe0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:17.509507 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8950924-9a17-4072-a1a3-84a8ccf9cbe0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:17.510732 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-c8950924-9a17-4072-a1a3-84a8ccf9cbe0 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/bd1cb161-115f-4b95-8f4b-b6fe28feeecd HTTP/1.1" status: 204 len: 168 time: 0.1270676 Dec 09 14:50:17.520977 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8950924-9a17-4072-a1a3-84a8ccf9cbe0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd1cb161-115f-4b95-8f4b-b6fe28feeecd,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:17.628761 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33040) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:17.784811 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fdfa5eff-9e09-4f70-94f5-d8e9042ff80a admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:17.869015 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fdfa5eff-9e09-4f70-94f5-d8e9042ff80a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:17.876111 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-fdfa5eff-9e09-4f70-94f5-d8e9042ff80a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:17.915175 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-fdfa5eff-9e09-4f70-94f5-d8e9042ff80a admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=d059bc0e82274276bfdf5aa73256eecb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2850780 Dec 09 14:50:17.917247 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdfa5eff-9e09-4f70-94f5-d8e9042ff80a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6f1a2418-898f-4298-8700-3391f357ee64,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:17.918589 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33052) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:17.968760 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-13a9f1cb-1dee-4d69-81c0-a51275e0e806 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:17.989914 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-13a9f1cb-1dee-4d69-81c0-a51275e0e806 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:18.040792 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-13a9f1cb-1dee-4d69-81c0-a51275e0e806 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:18.043480 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-13a9f1cb-1dee-4d69-81c0-a51275e0e806 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:18.044669 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-13a9f1cb-1dee-4d69-81c0-a51275e0e806 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/6f1a2418-898f-4298-8700-3391f357ee64 HTTP/1.1" status: 204 len: 168 time: 0.1247811 Dec 09 14:50:18.052415 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13a9f1cb-1dee-4d69-81c0-a51275e0e806 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6f1a2418-898f-4298-8700-3391f357ee64,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:18.440189 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33074) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:18.454627 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-017c4729-c90a-421b-909e-a7a0864c26d2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:18.533478 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-017c4729-c90a-421b-909e-a7a0864c26d2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:18.538124 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-017c4729-c90a-421b-909e-a7a0864c26d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:18.577606 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-017c4729-c90a-421b-909e-a7a0864c26d2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=526160c2-243b-4603-abf1-3540e8c8a6a8,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:18.581944 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-017c4729-c90a-421b-909e-a7a0864c26d2 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=519991d449834b6a9d24490e28a0d420&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1407032 Dec 09 14:50:18.584573 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33078) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:18.634951 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ea144270-3f07-4938-8c1f-4b4d96fbe80c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:18.656482 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ea144270-3f07-4938-8c1f-4b4d96fbe80c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:18.704785 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ea144270-3f07-4938-8c1f-4b4d96fbe80c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:18.707575 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ea144270-3f07-4938-8c1f-4b4d96fbe80c admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:18.711140 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-ea144270-3f07-4938-8c1f-4b4d96fbe80c admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/526160c2-243b-4603-abf1-3540e8c8a6a8 HTTP/1.1" status: 204 len: 168 time: 0.1232789 Dec 09 14:50:18.717419 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea144270-3f07-4938-8c1f-4b4d96fbe80c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=526160c2-243b-4603-abf1-3540e8c8a6a8,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:20.271812 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33140) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:20.383805 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3e7b881e-9b42-4aaa-bade-84bb996c946f admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:20.465328 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3e7b881e-9b42-4aaa-bade-84bb996c946f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:20.470719 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-3e7b881e-9b42-4aaa-bade-84bb996c946f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:20.511753 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-3e7b881e-9b42-4aaa-bade-84bb996c946f admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=6a86de80c55a4d039195e9cd810200e9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2387676 Dec 09 14:50:20.512706 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e7b881e-9b42-4aaa-bade-84bb996c946f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ccf2f6f1-b12e-4922-8d70-8d932f19ea2f,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:20.514659 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33154) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:20.580001 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cd951f52-ef4a-4de8-bc53-9f4e14b1c87d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:20.602822 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cd951f52-ef4a-4de8-bc53-9f4e14b1c87d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:20.653058 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cd951f52-ef4a-4de8-bc53-9f4e14b1c87d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:20.657111 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-cd951f52-ef4a-4de8-bc53-9f4e14b1c87d admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:20.658874 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-cd951f52-ef4a-4de8-bc53-9f4e14b1c87d admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/ccf2f6f1-b12e-4922-8d70-8d932f19ea2f HTTP/1.1" status: 204 len: 168 time: 0.1427011 Dec 09 14:50:20.666717 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd951f52-ef4a-4de8-bc53-9f4e14b1c87d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ccf2f6f1-b12e-4922-8d70-8d932f19ea2f,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:20.970417 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33162) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:20.984225 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3f694c5c-e82b-4afa-b1d8-3ea5b85afc63 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:21.064964 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3f694c5c-e82b-4afa-b1d8-3ea5b85afc63 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:21.071086 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-3f694c5c-e82b-4afa-b1d8-3ea5b85afc63 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:21.108536 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f694c5c-e82b-4afa-b1d8-3ea5b85afc63 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5f84d698-271e-44ec-ae4d-dd0247c347fb,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:21.114204 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-3f694c5c-e82b-4afa-b1d8-3ea5b85afc63 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=485ac722c0364ebb82847055321a4e18&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1426926 Dec 09 14:50:21.117033 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33164) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:21.168470 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-961e842e-36f3-4fb1-bad3-3cfdec195957 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:21.191440 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-961e842e-36f3-4fb1-bad3-3cfdec195957 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:21.245795 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-961e842e-36f3-4fb1-bad3-3cfdec195957 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:21.248516 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-961e842e-36f3-4fb1-bad3-3cfdec195957 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:21.249692 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-961e842e-36f3-4fb1-bad3-3cfdec195957 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/5f84d698-271e-44ec-ae4d-dd0247c347fb HTTP/1.1" status: 204 len: 168 time: 0.1317654 Dec 09 14:50:21.258441 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-961e842e-36f3-4fb1-bad3-3cfdec195957 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5f84d698-271e-44ec-ae4d-dd0247c347fb,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:21.822394 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33186) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:21.937967 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-114b786c-6f1c-4b79-aac8-4e7b8ab53391 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:22.017606 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-114b786c-6f1c-4b79-aac8-4e7b8ab53391 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:22.022885 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-114b786c-6f1c-4b79-aac8-4e7b8ab53391 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:22.063292 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-114b786c-6f1c-4b79-aac8-4e7b8ab53391 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=0aecf15d6d3e4f6fb7b9ca0a38be3d9e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2397923 Dec 09 14:50:22.065320 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-114b786c-6f1c-4b79-aac8-4e7b8ab53391 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=66495ace-d6c9-4cdc-a859-1a99731ad7b0,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:22.066098 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33198) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:22.115153 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-968e832b-294e-46fa-91f4-a1651ab1c772 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:22.138368 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-968e832b-294e-46fa-91f4-a1651ab1c772 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:22.190805 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-968e832b-294e-46fa-91f4-a1651ab1c772 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:22.193697 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-968e832b-294e-46fa-91f4-a1651ab1c772 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:22.194745 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-968e832b-294e-46fa-91f4-a1651ab1c772 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/66495ace-d6c9-4cdc-a859-1a99731ad7b0 HTTP/1.1" status: 204 len: 168 time: 0.1276124 Dec 09 14:50:22.202758 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-968e832b-294e-46fa-91f4-a1651ab1c772 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=66495ace-d6c9-4cdc-a859-1a99731ad7b0,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:22.518116 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33216) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:22.531997 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-19ac27d0-b1f2-4b49-a680-6dffa05a3e6b admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:22.607204 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-19ac27d0-b1f2-4b49-a680-6dffa05a3e6b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:22.612665 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-19ac27d0-b1f2-4b49-a680-6dffa05a3e6b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:22.654568 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-19ac27d0-b1f2-4b49-a680-6dffa05a3e6b admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=c6e52367de9b49a38c81ff13ec82dea4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1349249 Dec 09 14:50:22.655339 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19ac27d0-b1f2-4b49-a680-6dffa05a3e6b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1cb1c978-e4b8-4112-9e7f-8020f443b763,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:22.656955 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33222) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:22.705185 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1bde5327-db06-4736-8919-e8566a58f35b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:22.732912 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1bde5327-db06-4736-8919-e8566a58f35b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:22.784047 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1bde5327-db06-4736-8919-e8566a58f35b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:22.786646 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-1bde5327-db06-4736-8919-e8566a58f35b admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:22.787844 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-1bde5327-db06-4736-8919-e8566a58f35b admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/1cb1c978-e4b8-4112-9e7f-8020f443b763 HTTP/1.1" status: 204 len: 168 time: 0.1298659 Dec 09 14:50:22.800224 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bde5327-db06-4736-8919-e8566a58f35b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1cb1c978-e4b8-4112-9e7f-8020f443b763,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:23.084235 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33244) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:23.188179 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7928f7e8-9d80-496f-a529-fcfd9b813348 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:23.269756 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7928f7e8-9d80-496f-a529-fcfd9b813348 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:23.274531 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7928f7e8-9d80-496f-a529-fcfd9b813348 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:23.314922 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-7928f7e8-9d80-496f-a529-fcfd9b813348 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=443e579b44d34cbda4e3964d6305f171&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2295873 Dec 09 14:50:23.315928 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7928f7e8-9d80-496f-a529-fcfd9b813348 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f36e626-c905-47dc-8dcb-e2ead68f2675,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:23.317646 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33256) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:23.379196 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-70223b8c-fa45-453d-8320-392e99cba941 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:23.400967 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-70223b8c-fa45-453d-8320-392e99cba941 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:23.451462 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-70223b8c-fa45-453d-8320-392e99cba941 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:23.454385 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-70223b8c-fa45-453d-8320-392e99cba941 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:23.455708 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-70223b8c-fa45-453d-8320-392e99cba941 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/3f36e626-c905-47dc-8dcb-e2ead68f2675 HTTP/1.1" status: 204 len: 168 time: 0.1363456 Dec 09 14:50:23.464404 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70223b8c-fa45-453d-8320-392e99cba941 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f36e626-c905-47dc-8dcb-e2ead68f2675,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:23.778033 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33278) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:23.791240 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c25d2ab7-e665-4034-855e-b53c0314a9e6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:23.869002 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c25d2ab7-e665-4034-855e-b53c0314a9e6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:23.873681 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c25d2ab7-e665-4034-855e-b53c0314a9e6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:23.913555 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-c25d2ab7-e665-4034-855e-b53c0314a9e6 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=52c1173aad09482bbc28fd7cc6fbd6f8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1344459 Dec 09 14:50:23.914456 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c25d2ab7-e665-4034-855e-b53c0314a9e6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e4085f63-a34d-4289-b18f-b1b00cf89f13,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:23.916541 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33280) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:23.968648 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2a39b493-1d63-4db8-a95b-52e5ca9c4110 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:23.989256 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2a39b493-1d63-4db8-a95b-52e5ca9c4110 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:24.012275 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33284) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:24.036192 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2a39b493-1d63-4db8-a95b-52e5ca9c4110 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:24.038799 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2a39b493-1d63-4db8-a95b-52e5ca9c4110 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:24.040051 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-2a39b493-1d63-4db8-a95b-52e5ca9c4110 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/e4085f63-a34d-4289-b18f-b1b00cf89f13 HTTP/1.1" status: 204 len: 168 time: 0.1222997 Dec 09 14:50:24.047813 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a39b493-1d63-4db8-a95b-52e5ca9c4110 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e4085f63-a34d-4289-b18f-b1b00cf89f13,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:24.122708 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e1488916-dfee-4ce0-a0fb-460c7765cc93 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:24.198021 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e1488916-dfee-4ce0-a0fb-460c7765cc93 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:24.202871 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e1488916-dfee-4ce0-a0fb-460c7765cc93 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:24.240949 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-e1488916-dfee-4ce0-a0fb-460c7765cc93 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=58ab252dd902411baa81a9cff6f46d5c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2275956 Dec 09 14:50:24.241812 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e1488916-dfee-4ce0-a0fb-460c7765cc93 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1e689f4b-f755-4ac1-bad3-ff04f2455e36,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:24.243643 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33294) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:24.293623 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-80489c0a-702c-4bf0-bd70-5e58fce9cf0d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:24.314786 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-80489c0a-702c-4bf0-bd70-5e58fce9cf0d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:24.362856 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-80489c0a-702c-4bf0-bd70-5e58fce9cf0d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:24.367464 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-80489c0a-702c-4bf0-bd70-5e58fce9cf0d admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:24.369550 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-80489c0a-702c-4bf0-bd70-5e58fce9cf0d admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/1e689f4b-f755-4ac1-bad3-ff04f2455e36 HTTP/1.1" status: 204 len: 168 time: 0.1244342 Dec 09 14:50:24.382394 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80489c0a-702c-4bf0-bd70-5e58fce9cf0d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1e689f4b-f755-4ac1-bad3-ff04f2455e36,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:27.024389 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-c6e35b6f-a569-40d7-add2-f69e868230c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:28.100218 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33408) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:28.214345 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4c0986c1-86b8-4d61-ad9c-cbf480e2d4a6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:28.290051 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4c0986c1-86b8-4d61-ad9c-cbf480e2d4a6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:28.297114 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-4c0986c1-86b8-4d61-ad9c-cbf480e2d4a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:28.335438 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-4c0986c1-86b8-4d61-ad9c-cbf480e2d4a6 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=d20ff8d400bd4fb597ab115028d5b3b5&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2339926 Dec 09 14:50:28.336690 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c0986c1-86b8-4d61-ad9c-cbf480e2d4a6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb0b2617-1356-406d-b515-ad83f7a41397,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:28.338396 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33412) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:28.389593 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5a6d25d2-132c-421e-aab2-552530059ae3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:28.411162 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5a6d25d2-132c-421e-aab2-552530059ae3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:28.461515 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5a6d25d2-132c-421e-aab2-552530059ae3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:28.464179 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5a6d25d2-132c-421e-aab2-552530059ae3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:28.465360 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-5a6d25d2-132c-421e-aab2-552530059ae3 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/eb0b2617-1356-406d-b515-ad83f7a41397 HTTP/1.1" status: 204 len: 168 time: 0.1251020 Dec 09 14:50:28.474294 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a6d25d2-132c-421e-aab2-552530059ae3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb0b2617-1356-406d-b515-ad83f7a41397,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:29.185839 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-e256bc8b-8f65-4561-a801-3b745d65c55b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:29.511488 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33450) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:29.620561 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e8ed64d1-da69-4464-abdb-e683a81753b4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:29.696795 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e8ed64d1-da69-4464-abdb-e683a81753b4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:29.703252 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e8ed64d1-da69-4464-abdb-e683a81753b4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:29.740520 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8ed64d1-da69-4464-abdb-e683a81753b4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b5d9b0a9-951b-48db-8be8-06d98bab0c8d,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:29.746086 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-e8ed64d1-da69-4464-abdb-e683a81753b4 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=ee4b77c8e9ce41ba8a99b69a8be36caa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2335205 Dec 09 14:50:29.748754 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33454) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:29.797324 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d5d206ff-5074-49a1-a34d-3d814dbf3abd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:29.818896 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d5d206ff-5074-49a1-a34d-3d814dbf3abd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:29.866020 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d5d206ff-5074-49a1-a34d-3d814dbf3abd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:29.868832 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d5d206ff-5074-49a1-a34d-3d814dbf3abd admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:29.870363 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-d5d206ff-5074-49a1-a34d-3d814dbf3abd admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/b5d9b0a9-951b-48db-8be8-06d98bab0c8d HTTP/1.1" status: 204 len: 168 time: 0.1203580 Dec 09 14:50:29.879198 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5d206ff-5074-49a1-a34d-3d814dbf3abd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b5d9b0a9-951b-48db-8be8-06d98bab0c8d,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:30.442898 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:30.514951 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33494) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:30.615936 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1920504822-network', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:30.643905 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] Made reservation on behalf of 9e02a1db560b45ddbee50b9e57d1f4f0 for: {'network': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:50:30.646466 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:30.654860 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:30.733197 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:30.738506 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:30.762633 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 400} {{(pid=109061) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:50:30.772228 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=84c335f5-1b09-4d7b-a97c-3ce21937ac9f,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:30.776923 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:30.777249 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.segments_db [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] Added segment a705bcc4-c3b3-42a8-bec6-657a4661427a of type vlan for network 245ba82b-ada3-409a-912d-4462e3cd3ab8 Dec 09 14:50:30.818874 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:30.846133 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:30.847209 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:30.847969 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:30.905237 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.3889341 Dec 09 14:50:30.908609 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33498) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:30.912938 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9b9c5e4-4c4a-430c-8e55-7410f419d969 admin admin] Pushing event updated for resources: {'Network': ['ID=245ba82b-ada3-409a-912d-4462e3cd3ab8,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:30.913973 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-a0835145-a442-4f0e-b71e-fe9ab75194ec admin admin] Request body: {'subnet': {'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1920504822-subnet', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'ip_version': 4}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:30.926535 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network 245ba82b-ada3-409a-912d-4462e3cd3ab8 details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:50:30.944694 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a0835145-a442-4f0e-b71e-fe9ab75194ec admin admin] Made reservation on behalf of 9e02a1db560b45ddbee50b9e57d1f4f0 for: {'subnet': 1} {{(pid=109062) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:50:30.947047 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a0835145-a442-4f0e-b71e-fe9ab75194ec admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-130588657'] for subnet, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.109789 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a0835145-a442-4f0e-b71e-fe9ab75194ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-130461295', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-130768923'] for subnet, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.162705 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0835145-a442-4f0e-b71e-fe9ab75194ec admin admin] Pushing event updated for resources: {'Subnet': ['ID=548e3893-a447-4905-aa48-fd4e75373585,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:31.174280 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0835145-a442-4f0e-b71e-fe9ab75194ec admin admin] Checking segment: {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109062) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:50:31.174648 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0835145-a442-4f0e-b71e-fe9ab75194ec admin admin] Network hostable DHCP agents. Network: 245ba82b-ada3-409a-912d-4462e3cd3ab8, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109062) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:50:31.194375 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0835145-a442-4f0e-b71e-fe9ab75194ec admin admin] Network 245ba82b-ada3-409a-912d-4462e3cd3ab8 is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109062) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:50:31.204684 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-a0835145-a442-4f0e-b71e-fe9ab75194ec admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, 245ba82b-ada3-409a-912d-4462e3cd3ab8) {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:50:31.209886 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a0835145-a442-4f0e-b71e-fe9ab75194ec admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:31.211186 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a0835145-a442-4f0e-b71e-fe9ab75194ec admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.213280 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3572659-20e6-437a-8012-30a284658bf6 None None] Network 245ba82b-ada3-409a-912d-4462e3cd3ab8 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:50:31.232367 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-a0835145-a442-4f0e-b71e-fe9ab75194ec admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.3226097 Dec 09 14:50:31.232676 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33508) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:31.238191 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:31.263882 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1626853', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30590'] for router, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.265184 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1626745', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1584168', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1653733', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30569'] for router, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.320680 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp191c2114-7e35-566a-a422-2a0bb50a5442-245ba82b-ada3-409a-912d-4462e3cd3ab8', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585'}]}} from dv-cinder-819692-8-iscsi. {{(pid=109063) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 14:50:31.321573 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.321808 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.388442 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33512) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:31.463470 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.db_base_plugin_common [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Allocated IP 172.20.0.2 (245ba82b-ada3-409a-912d-4462e3cd3ab8/548e3893-a447-4905-aa48-fd4e75373585/00b2689f-768f-4c56-a413-94826006dbf9) {{(pid=109063) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:50:31.466572 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.503452 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b54b24cc-f8e7-4957-8ab9-a3ae4f23f52f admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.581758 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b54b24cc-f8e7-4957-8ab9-a3ae4f23f52f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.586955 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b54b24cc-f8e7-4957-8ab9-a3ae4f23f52f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.621627 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Publish callbacks [] for port, precommit_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.621867 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-b54b24cc-f8e7-4957-8ab9-a3ae4f23f52f admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=69e55890fd644d47b56b324ebe329884&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2292774 Dec 09 14:50:31.623467 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33516) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:31.628356 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.638857 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b54b24cc-f8e7-4957-8ab9-a3ae4f23f52f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e965cee-cd8a-4e26-8d7f-b4c84a631e14,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:31.668770 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Network 245ba82b-ada3-409a-912d-4462e3cd3ab8 is already hosted by enough agents. {{(pid=109063) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:50:31.673621 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.base_scheduler [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Resources bound (agent type, host, resource id): {{(pid=109063) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:50:31.676084 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.677188 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Received port after_create {{(pid=109063) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:50:31.679814 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5513fa16-f3ca-4c1b-a773-39862e16b99b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.684148 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Pushing event updated for resources: {'Port': ['ID=00b2689f-768f-4c56-a413-94826006dbf9,revision_number=1']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:31.699903 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.702143 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5513fa16-f3ca-4c1b-a773-39862e16b99b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.712825 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:31.713440 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:31.713948 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:31.714444 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:31.714926 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:31.716634 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:31.716962 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:31.717456 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:31.717823 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:31.718159 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:31.718493 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:31.718916 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:31.719224 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:31.755548 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Attempting to bind port 00b2689f-768f-4c56-a413-94826006dbf9 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:50:31.756127 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Attempting to bind port 00b2689f-768f-4c56-a413-94826006dbf9 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:50:31.756520 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Attempting to bind port 00b2689f-768f-4c56-a413-94826006dbf9 on network 245ba82b-ada3-409a-912d-4462e3cd3ab8 {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:50:31.761962 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 50, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:50:31.762335 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Checking segment: {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:50:31.762885 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.763275 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Bound using segment: {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:50:31.763774 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Bound port: 00b2689f-768f-4c56-a413-94826006dbf9, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:50:31.764144 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.777852 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5513fa16-f3ca-4c1b-a773-39862e16b99b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.781737 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5513fa16-f3ca-4c1b-a773-39862e16b99b admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.785435 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-5513fa16-f3ca-4c1b-a773-39862e16b99b admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/9e965cee-cd8a-4e26-8d7f-b4c84a631e14 HTTP/1.1" status: 204 len: 168 time: 0.1585383 Dec 09 14:50:31.791660 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5513fa16-f3ca-4c1b-a773-39862e16b99b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e965cee-cd8a-4e26-8d7f-b4c84a631e14,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:31.823875 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Allocated IP 172.27.0.209 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/22aa78c6-5086-49e6-90b2-f0ea5ec6044f) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:50:31.843543 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.852986 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] For port 00b2689f-768f-4c56-a413-94826006dbf9, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:50:31.856113 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] For port 00b2689f-768f-4c56-a413-94826006dbf9, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=00b2689f-768f-4c56-a413-94826006dbf9,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:50:31.861290 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.921276 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76c717c4-de29-4b7d-949d-a49621b76e16 None None] Pushing event updated for resources: {'Port': ['ID=00b2689f-768f-4c56-a413-94826006dbf9,revision_number=2']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:31.951210 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:31.986483 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:32.029952 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:50:32.032922 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:50:32.038498 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:50:32.040635 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Pushing event updated for resources: {'Port': ['ID=22aa78c6-5086-49e6-90b2-f0ea5ec6044f,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:32.098850 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33522) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:32.144862 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e2684599-aad8-4d1c-8b03-2beace161d69 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:32.350373 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e2684599-aad8-4d1c-8b03-2beace161d69 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:32.358431 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-e2684599-aad8-4d1c-8b03-2beace161d69 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:32.392688 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:32.435040 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2684599-aad8-4d1c-8b03-2beace161d69 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9df0b90f-922d-431c-8501-93a9abc50387,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:32.441004 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-e2684599-aad8-4d1c-8b03-2beace161d69 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=6909ff1ace9040e0830062e4a7dbcc58&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3410223 Dec 09 14:50:32.443762 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33524) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:32.568284 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b8b1d818-0072-403a-bf5a-2c99c4f1e2f9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:32.605831 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:32.630967 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b8b1d818-0072-403a-bf5a-2c99c4f1e2f9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:32.674980 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1626736', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1574391'] for router, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:32.758932 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b8b1d818-0072-403a-bf5a-2c99c4f1e2f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:32.761587 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b8b1d818-0072-403a-bf5a-2c99c4f1e2f9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:32.762750 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-b8b1d818-0072-403a-bf5a-2c99c4f1e2f9 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/9df0b90f-922d-431c-8501-93a9abc50387 HTTP/1.1" status: 204 len: 168 time: 0.3181019 Dec 09 14:50:32.776189 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8b1d818-0072-403a-bf5a-2c99c4f1e2f9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9df0b90f-922d-431c-8501-93a9abc50387,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:32.827528 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Router 0afa8c36-934f-4ee2-8457-fb4e00214c4d is scheduled to L3 agent d9048829-2654-4d94-83cc-155a0884505e with binding_index 1 {{(pid=109061) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 14:50:32.885226 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fdf2fbec-0452-4541-b25a-f142b89ccaf6 None None] Network 245ba82b-ada3-409a-912d-4462e3cd3ab8 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:50:32.949701 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-4d7a0915-b8b1-4780-bb8b-d02ee4fddbec None None] Provisioning complete for port 00b2689f-768f-4c56-a413-94826006dbf9 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:32.950213 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4d7a0915-b8b1-4780-bb8b-d02ee4fddbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:33.071879 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4d7a0915-b8b1-4780-bb8b-d02ee4fddbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:33.109754 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-4d7a0915-b8b1-4780-bb8b-d02ee4fddbec None None] For port 00b2689f-768f-4c56-a413-94826006dbf9, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=00b2689f-768f-4c56-a413-94826006dbf9,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:33.117130 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-4d7a0915-b8b1-4780-bb8b-d02ee4fddbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:33.171693 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d7a0915-b8b1-4780-bb8b-d02ee4fddbec None None] Pushing event updated for resources: {'Port': ['ID=00b2689f-768f-4c56-a413-94826006dbf9,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:33.172749 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33530) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:33.193540 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-481f103a-8a12-400c-9712-5f5bf54b7825 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:33.258953 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:50:33.271247 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Sync routers for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:50:33.281596 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:33.283237 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-a2c7e601-d9d2-4000-9272-d660902e5678 admin admin] 10.222.0.39 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 2.0486987 Dec 09 14:50:33.286122 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33532) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:33.287173 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:33.287878 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:50:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:33.334251 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 00b2689f-768f-4c56-a413-94826006dbf9 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:50:33.348337 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-481f103a-8a12-400c-9712-5f5bf54b7825 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:33.354485 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-481f103a-8a12-400c-9712-5f5bf54b7825 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:33.430152 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-481f103a-8a12-400c-9712-5f5bf54b7825 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=aa8580f798bd46738e62281d843c9aef&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2561431 Dec 09 14:50:33.433008 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-481f103a-8a12-400c-9712-5f5bf54b7825 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e622637-4090-44e2-a418-d97814f79f2e,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:33.433319 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33534) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:33.496329 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-61c55015-a9e6-4d54-babb-6fb3b038caa6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:33.519194 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-61c55015-a9e6-4d54-babb-6fb3b038caa6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:33.556973 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-b3f0fcbe-4019-49af-8669-0708187fb506 None None] Provisioning complete for port 00b2689f-768f-4c56-a413-94826006dbf9 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:33.557323 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-b3f0fcbe-4019-49af-8669-0708187fb506 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:33.568988 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-61c55015-a9e6-4d54-babb-6fb3b038caa6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:33.571588 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-61c55015-a9e6-4d54-babb-6fb3b038caa6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:33.575338 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-61c55015-a9e6-4d54-babb-6fb3b038caa6 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/0e622637-4090-44e2-a418-d97814f79f2e HTTP/1.1" status: 204 len: 168 time: 0.1384268 Dec 09 14:50:33.582630 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-61c55015-a9e6-4d54-babb-6fb3b038caa6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e622637-4090-44e2-a418-d97814f79f2e,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:33.628895 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:33.692418 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 00b2689f-768f-4c56-a413-94826006dbf9 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:33.692695 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:33.945646 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:32Z', 'revision_number': 3, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:31Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:33.977343 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Checking router: 0afa8c36-934f-4ee2-8457-fb4e00214c4d for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:50:33.977790 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Updating router 0afa8c36-934f-4ee2-8457-fb4e00214c4d port 22aa78c6-5086-49e6-90b2-f0ea5ec6044f binding host dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:50:34.002818 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.043685 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.214211 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Allocated IP 172.20.0.1 (245ba82b-ada3-409a-912d-4462e3cd3ab8/548e3893-a447-4905-aa48-fd4e75373585/aabb4c34-a04c-4c90-8b7d-94b550c74426) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:50:34.273685 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Publish callbacks [] for port, precommit_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.281338 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.302249 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33556) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:34.330231 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.336181 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Attempting to bind port 22aa78c6-5086-49e6-90b2-f0ea5ec6044f on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:50:34.336421 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Attempting to bind port 22aa78c6-5086-49e6-90b2-f0ea5ec6044f by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:50:34.336853 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Attempting to bind port 22aa78c6-5086-49e6-90b2-f0ea5ec6044f on network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:50:34.339051 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3be1586-d3fb-4b09-be17-5e3d18756d53 None None] Pushing event updated for resources: {'Port': ['ID=22aa78c6-5086-49e6-90b2-f0ea5ec6044f,revision_number=2']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:34.345978 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 50, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:50:34.346166 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Checking segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:50:34.346583 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.346955 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Bound using segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:50:34.347424 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Bound port: 22aa78c6-5086-49e6-90b2-f0ea5ec6044f, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:50:34.347834 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.371867 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.407077 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] For port 22aa78c6-5086-49e6-90b2-f0ea5ec6044f, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:50:34.408030 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Network 245ba82b-ada3-409a-912d-4462e3cd3ab8 is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:50:34.410858 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] For port 22aa78c6-5086-49e6-90b2-f0ea5ec6044f, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=22aa78c6-5086-49e6-90b2-f0ea5ec6044f,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:50:34.415083 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1389110210-network', 'tenant_id': 'e851ff8bfba1434b916e3a2ae6ef065b'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:34.415529 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.419012 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:50:34.425547 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:50:34.442310 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] Made reservation on behalf of e851ff8bfba1434b916e3a2ae6ef065b for: {'network': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:50:34.445859 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.459008 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.462102 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Pushing event updated for resources: {'Port': ['ID=aabb4c34-a04c-4c90-8b7d-94b550c74426,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:34.478143 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1574184'] for router_interface, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.485272 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:34.485911 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:50:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:34.488001 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3be1586-d3fb-4b09-be17-5e3d18756d53 None None] Pushing event updated for resources: {'Port': ['ID=22aa78c6-5086-49e6-90b2-f0ea5ec6044f,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:34.551001 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.558333 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.584263 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0cc391e1-043d-4733-b34d-bcb07029588d,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:34.597765 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 434} {{(pid=109061) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:50:34.609146 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.609499 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.segments_db [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] Added segment 409d9627-ce84-4983-8ee7-6dc43e2a5de7 of type vlan for network 82bc4169-86f1-48dd-b3a9-b16bd54b9d6f Dec 09 14:50:34.634945 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.636644 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:34.657188 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.688764 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.690368 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:34.691238 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.762518 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4590783 Dec 09 14:50:34.765850 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33560) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:34.771966 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-ab469601-66e0-4d21-b63f-9f57cc4e7145 admin admin] Request body: {'subnet': {'network_id': '82bc4169-86f1-48dd-b3a9-b16bd54b9d6f', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1389110210-subnet', 'tenant_id': 'e851ff8bfba1434b916e3a2ae6ef065b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:34.783510 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-8efb7551-37fa-491c-ad05-71867eee8bdc None None] Provisioning complete for port aabb4c34-a04c-4c90-8b7d-94b550c74426 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:34.783903 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-8efb7551-37fa-491c-ad05-71867eee8bdc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.785624 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad400aca-bb5e-4991-8a58-ccb5ec3d6a95 admin admin] Pushing event updated for resources: {'Network': ['ID=82bc4169-86f1-48dd-b3a9-b16bd54b9d6f,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:34.804430 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ab469601-66e0-4d21-b63f-9f57cc4e7145 admin admin] Made reservation on behalf of e851ff8bfba1434b916e3a2ae6ef065b for: {'subnet': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:50:34.807468 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ab469601-66e0-4d21-b63f-9f57cc4e7145 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-133483919'] for subnet, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.818706 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network 82bc4169-86f1-48dd-b3a9-b16bd54b9d6f details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:50:34.825874 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.831889 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-130461426'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.897670 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Pushing event updated for resources: {'Port': ['ID=aabb4c34-a04c-4c90-8b7d-94b550c74426,revision_number=2']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:34.904467 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2066007', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1629368'] for router_interface, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.932742 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-8efb7551-37fa-491c-ad05-71867eee8bdc None None] Port aabb4c34-a04c-4c90-8b7d-94b550c74426 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:50:34.966934 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:32Z', 'revision_number': 3, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:34.987353 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ab469601-66e0-4d21-b63f-9f57cc4e7145 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-133412248', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-133640805'] for subnet, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:34.992537 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Network 245ba82b-ada3-409a-912d-4462e3cd3ab8 is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:50:34.994008 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:50:34.999220 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b3805613-c8f3-43bb-a295-2dd48db93613 None None] The sync data for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi is: [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:32Z', 'revision_number': 3, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:50:35.057497 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab469601-66e0-4d21-b63f-9f57cc4e7145 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b057d961-cd95-47ff-9c01-42519e40216d,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:35.067155 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ab469601-66e0-4d21-b63f-9f57cc4e7145 admin admin] Checking segment: {'id': '409d9627-ce84-4983-8ee7-6dc43e2a5de7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 434, 'network_id': '82bc4169-86f1-48dd-b3a9-b16bd54b9d6f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:50:35.067751 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab469601-66e0-4d21-b63f-9f57cc4e7145 admin admin] Network hostable DHCP agents. Network: 82bc4169-86f1-48dd-b3a9-b16bd54b9d6f, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109061) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:50:35.092653 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ab469601-66e0-4d21-b63f-9f57cc4e7145 admin admin] Network 82bc4169-86f1-48dd-b3a9-b16bd54b9d6f is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109061) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:50:35.110432 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-ab469601-66e0-4d21-b63f-9f57cc4e7145 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, 82bc4169-86f1-48dd-b3a9-b16bd54b9d6f) {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:50:35.116982 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ab469601-66e0-4d21-b63f-9f57cc4e7145 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:35.117757 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ab469601-66e0-4d21-b63f-9f57cc4e7145 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:35.125239 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c1713410-bb8e-45b8-9682-c8215ade99d9 None None] Network 82bc4169-86f1-48dd-b3a9-b16bd54b9d6f requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:50:35.145823 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Router 0afa8c36-934f-4ee2-8457-fb4e00214c4d has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:50:35.154322 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-ab469601-66e0-4d21-b63f-9f57cc4e7145 admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3869956 Dec 09 14:50:35.273889 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:50:35.280416 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-a72fd042-1536-4ab4-a2d9-4f332ce77900 admin admin] 10.222.0.39 "PUT /v2.0/routers/0afa8c36-934f-4ee2-8457-fb4e00214c4d/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9931755 Dec 09 14:50:35.294463 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-740f6e76-52c8-46dc-9798-08d6ef87c7ad None None] Network 82bc4169-86f1-48dd-b3a9-b16bd54b9d6f requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:50:35.415066 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-ac794d1e-1e0b-4a87-a312-037b7ad82317 None None] Provisioning complete for port aabb4c34-a04c-4c90-8b7d-94b550c74426 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:35.415448 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-ac794d1e-1e0b-4a87-a312-037b7ad82317 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:35.478258 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-ac794d1e-1e0b-4a87-a312-037b7ad82317 None None] Port aabb4c34-a04c-4c90-8b7d-94b550c74426 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:50:35.856351 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33586) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:35.861722 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-587319122-network', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:35.885132 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] Made reservation on behalf of 065be8eed6174ffd941b9a5500ba878c for: {'network': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:50:35.887669 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for network, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:35.897485 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:35.978467 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:35.984321 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:36.008992 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 411} {{(pid=109061) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Dec 09 14:50:36.018676 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=097edbc9-63e0-45a5-8191-cd28804e2b43,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:36.023505 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:36.023862 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.segments_db [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] Added segment 339d7547-a985-4aa6-9bcd-8bde772cd987 of type vlan for network ea889acf-d9a7-46d5-8f93-62ab83c7501b Dec 09 14:50:36.062531 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8747842475632'] for network, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:36.090159 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021'] for network, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:36.091035 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:36.091777 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:36.146613 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] 10.222.0.39 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.2889268 Dec 09 14:50:36.149360 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33588) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:36.156060 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-b09e9198-48dc-4142-adf8-1e48245cacab admin admin] Request body: {'subnet': {'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-587319122-subnet', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'ip_version': 4}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:36.160446 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95c1ef49-9361-4155-aa82-9ef59afe47df admin admin] Pushing event updated for resources: {'Network': ['ID=ea889acf-d9a7-46d5-8f93-62ab83c7501b,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:36.171056 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Network ea889acf-d9a7-46d5-8f93-62ab83c7501b details requested by agent ovs-agent-dv-cinder-819692-8-iscsi with host dv-cinder-819692-8-iscsi {{(pid=109063) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Dec 09 14:50:36.180996 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b09e9198-48dc-4142-adf8-1e48245cacab admin admin] Made reservation on behalf of 065be8eed6174ffd941b9a5500ba878c for: {'subnet': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:50:36.183412 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b09e9198-48dc-4142-adf8-1e48245cacab admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-133483919'] for subnet, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:36.351836 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b09e9198-48dc-4142-adf8-1e48245cacab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-133412248', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-133640805'] for subnet, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:36.412142 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b09e9198-48dc-4142-adf8-1e48245cacab admin admin] Pushing event updated for resources: {'Subnet': ['ID=b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:36.423031 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b09e9198-48dc-4142-adf8-1e48245cacab admin admin] Checking segment: {'id': '339d7547-a985-4aa6-9bcd-8bde772cd987', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:50:36.423403 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b09e9198-48dc-4142-adf8-1e48245cacab admin admin] Network hostable DHCP agents. Network: ea889acf-d9a7-46d5-8f93-62ab83c7501b, hostable agents: ['a7ff4d96-6d81-4665-a6f5-cc966db3d30e'], hosted agents: [] {{(pid=109061) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Dec 09 14:50:36.441550 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b09e9198-48dc-4142-adf8-1e48245cacab admin admin] Network ea889acf-d9a7-46d5-8f93-62ab83c7501b is scheduled to be hosted by DHCP agent a7ff4d96-6d81-4665-a6f5-cc966db3d30e with binding_index 1 {{(pid=109061) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Dec 09 14:50:36.451223 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-b09e9198-48dc-4142-adf8-1e48245cacab admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-819692-8-iscsi, ea889acf-d9a7-46d5-8f93-62ab83c7501b) {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:50:36.456508 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b09e9198-48dc-4142-adf8-1e48245cacab admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:36.457166 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-b09e9198-48dc-4142-adf8-1e48245cacab admin admin] Publish callbacks [] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:36.461103 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-88b365cb-fc4d-4815-80a5-f62cd9065238 None None] Network ea889acf-d9a7-46d5-8f93-62ab83c7501b requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:50:36.474718 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-b09e9198-48dc-4142-adf8-1e48245cacab admin admin] 10.222.0.39 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3224978 Dec 09 14:50:36.477354 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33590) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:36.482582 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-587319122-router', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:36.505764 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1626853', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-30590'] for router, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:36.507021 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1626745', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1584168', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1653733', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-30569'] for router, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:36.560813 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:36.566554 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp191c2114-7e35-566a-a422-2a0bb50a5442-ea889acf-d9a7-46d5-8f93-62ab83c7501b', 'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b', 'project_id': '065be8eed6174ffd941b9a5500ba878c', 'fixed_ips': [{'subnet_id': 'b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7'}]}} from dv-cinder-819692-8-iscsi. {{(pid=109063) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:296}} Dec 09 14:50:36.567928 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:36.706871 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.db_base_plugin_common [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Allocated IP 172.20.0.2 (ea889acf-d9a7-46d5-8f93-62ab83c7501b/b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7/d2c041c6-719a-435f-8051-f823b16ff2d8) {{(pid=109063) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:50:36.708831 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:36.773026 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Sync routers for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:50:36.786571 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:36.787685 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:50:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:36.867995 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Publish callbacks [] for port, precommit_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:36.881590 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950'] for port, after_create {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:36.899550 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:36.946767 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Network ea889acf-d9a7-46d5-8f93-62ab83c7501b is already hosted by enough agents. {{(pid=109063) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:50:36.952710 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.scheduler.base_scheduler [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Resources bound (agent type, host, resource id): {{(pid=109063) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:50:36.955057 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Pushing event updated for resources: {'Port': ['ID=d2c041c6-719a-435f-8051-f823b16ff2d8,revision_number=1']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:36.957426 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Received port after_create {{(pid=109063) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:50:37.010841 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Attempting to bind port d2c041c6-719a-435f-8051-f823b16ff2d8 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:50:37.011093 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Attempting to bind port d2c041c6-719a-435f-8051-f823b16ff2d8 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': '339d7547-a985-4aa6-9bcd-8bde772cd987', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:50:37.011455 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Attempting to bind port d2c041c6-719a-435f-8051-f823b16ff2d8 on network ea889acf-d9a7-46d5-8f93-62ab83c7501b {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:50:37.016463 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 50, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:50:37.016832 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Checking segment: {'id': '339d7547-a985-4aa6-9bcd-8bde772cd987', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:50:37.017231 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.017619 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Bound using segment: {'id': '339d7547-a985-4aa6-9bcd-8bde772cd987', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:50:37.018080 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Bound port: d2c041c6-719a-435f-8051-f823b16ff2d8, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '339d7547-a985-4aa6-9bcd-8bde772cd987', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:50:37.018454 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.026419 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.050312 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.081918 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] For port d2c041c6-719a-435f-8051-f823b16ff2d8, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:50:37.085202 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] For port d2c041c6-719a-435f-8051-f823b16ff2d8, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=d2c041c6-719a-435f-8051-f823b16ff2d8,segment=NetworkSegment(339d7547-a985-4aa6-9bcd-8bde772cd987),segment_id=339d7547-a985-4aa6-9bcd-8bde772cd987)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:50:37.089880 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.105283 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 2, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:37.128441 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-2d8f1571-2288-46ad-9ca4-5419953eca0b tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:37.134137 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Checking router: 0afa8c36-934f-4ee2-8457-fb4e00214c4d for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:50:37.134596 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Updating router 0afa8c36-934f-4ee2-8457-fb4e00214c4d port aabb4c34-a04c-4c90-8b7d-94b550c74426 binding host dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:50:37.136155 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-2d8f1571-2288-46ad-9ca4-5419953eca0b tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/networks?id=82bc4169-86f1-48dd-b3a9-b16bd54b9d6f HTTP/1.1" status: 200 len: 809 time: 0.2174997 Dec 09 14:50:37.150276 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10ed73ee-c6e0-44ca-b915-830b2e83242e None None] Pushing event updated for resources: {'Port': ['ID=d2c041c6-719a-435f-8051-f823b16ff2d8,revision_number=2']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:37.166827 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.166977 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-9ac662dc-c3b3-4dfd-86b0-67382e0e0b30 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/quotas/e851ff8bfba1434b916e3a2ae6ef065b HTTP/1.1" status: 200 len: 375 time: 0.0289876 Dec 09 14:50:37.221076 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-ea9341c5-b515-4beb-a12a-971304dbe27f tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=e851ff8bfba1434b916e3a2ae6ef065b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0532830 Dec 09 14:50:37.253672 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Allocated IP 172.27.0.11 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/7ca0ba75-484d-4138-b03a-ffa267941846) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:50:37.310027 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 22aa78c6-5086-49e6-90b2-f0ea5ec6044f up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:50:37.493797 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.521492 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Publish callbacks [] for port, precommit_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.533212 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.552583 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-a9f3ab5c-743a-4437-b104-363e022e9ad1 service neutron] 10.222.0.39 "GET /v2.0/networks/82bc4169-86f1-48dd-b3a9-b16bd54b9d6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3306189 Dec 09 14:50:37.571325 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 22aa78c6-5086-49e6-90b2-f0ea5ec6044f triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:37.571728 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.580881 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.588642 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2df1cc8f-3762-46df-a0b5-d3d0eb56f18d None None] Pushing event updated for resources: {'Port': ['ID=aabb4c34-a04c-4c90-8b7d-94b550c74426,revision_number=3']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:37.596682 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2df1cc8f-3762-46df-a0b5-d3d0eb56f18d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:37.598086 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2df1cc8f-3762-46df-a0b5-d3d0eb56f18d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:37.598503 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2df1cc8f-3762-46df-a0b5-d3d0eb56f18d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:37.598895 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2df1cc8f-3762-46df-a0b5-d3d0eb56f18d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:37.599419 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2df1cc8f-3762-46df-a0b5-d3d0eb56f18d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:37.599953 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2df1cc8f-3762-46df-a0b5-d3d0eb56f18d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:37.600440 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2df1cc8f-3762-46df-a0b5-d3d0eb56f18d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:37.600777 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2df1cc8f-3762-46df-a0b5-d3d0eb56f18d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:37.601095 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2df1cc8f-3762-46df-a0b5-d3d0eb56f18d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:37.601587 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2df1cc8f-3762-46df-a0b5-d3d0eb56f18d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:37.602058 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2df1cc8f-3762-46df-a0b5-d3d0eb56f18d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:37.602388 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2df1cc8f-3762-46df-a0b5-d3d0eb56f18d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:37.602710 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2df1cc8f-3762-46df-a0b5-d3d0eb56f18d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109064) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:50:37.663178 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Attempting to bind port aabb4c34-a04c-4c90-8b7d-94b550c74426 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:50:37.663545 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Attempting to bind port aabb4c34-a04c-4c90-8b7d-94b550c74426 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:50:37.664007 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Attempting to bind port aabb4c34-a04c-4c90-8b7d-94b550c74426 on network 245ba82b-ada3-409a-912d-4462e3cd3ab8 {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:50:37.665969 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:50:37.669327 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 50, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:50:37.669705 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Checking segment: {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109064) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:50:37.670158 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.670583 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Bound using segment: {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:50:37.671224 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Bound port: aabb4c34-a04c-4c90-8b7d-94b550c74426, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'}}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:50:37.671842 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.672468 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:50:37.674240 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.687017 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:50:37.709880 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] For port 22aa78c6-5086-49e6-90b2-f0ea5ec6044f, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=22aa78c6-5086-49e6-90b2-f0ea5ec6044f,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:37.718527 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.734058 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Pushing event updated for resources: {'Port': ['ID=7ca0ba75-484d-4138-b03a-ffa267941846,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:37.749050 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] For port aabb4c34-a04c-4c90-8b7d-94b550c74426, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109064) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:50:37.752470 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] For port aabb4c34-a04c-4c90-8b7d-94b550c74426, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=aabb4c34-a04c-4c90-8b7d-94b550c74426,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109064) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:50:37.761697 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:37.763121 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-0a0eeee1-d84e-4538-baef-8199b43261b5 service neutron] 10.222.0.39 "GET /v2.0/networks/82bc4169-86f1-48dd-b3a9-b16bd54b9d6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2026882 Dec 09 14:50:37.804185 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Pushing event updated for resources: {'Port': ['ID=22aa78c6-5086-49e6-90b2-f0ea5ec6044f,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:37.839959 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2df1cc8f-3762-46df-a0b5-d3d0eb56f18d None None] Pushing event updated for resources: {'Port': ['ID=aabb4c34-a04c-4c90-8b7d-94b550c74426,revision_number=4']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:37.852260 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:37.853079 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:50:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:37.931301 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-11a2bdf0-ca30-474e-a7fd-d5a6d9c8325f None None] Provisioning complete for port aabb4c34-a04c-4c90-8b7d-94b550c74426 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:37.931718 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-11a2bdf0-ca30-474e-a7fd-d5a6d9c8325f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:38.025476 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:38.069121 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-95f5178f-ef13-4abc-8691-962d5c966c94 req-f887d2d1-58c9-4666-9381-22120651113e tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 210 time: 0.0596724 Dec 09 14:50:38.118391 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:38.120507 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-11a2bdf0-ca30-474e-a7fd-d5a6d9c8325f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:38.189562 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-11a2bdf0-ca30-474e-a7fd-d5a6d9c8325f None None] For port aabb4c34-a04c-4c90-8b7d-94b550c74426, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=aabb4c34-a04c-4c90-8b7d-94b550c74426,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:38.204088 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-11a2bdf0-ca30-474e-a7fd-d5a6d9c8325f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:38.285415 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11a2bdf0-ca30-474e-a7fd-d5a6d9c8325f None None] Pushing event updated for resources: {'Port': ['ID=aabb4c34-a04c-4c90-8b7d-94b550c74426,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:38.348639 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3c0b2370-19fd-491a-aafe-27bcdf53b250 None None] Provisioning complete for port aabb4c34-a04c-4c90-8b7d-94b550c74426 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:38.349329 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3c0b2370-19fd-491a-aafe-27bcdf53b250 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:38.400585 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1626736', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1574391'] for router, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:38.467466 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:38.498180 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4bd1171-7e26-4844-a848-8be17070076e None None] The sync data for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi is: [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:50:38.515708 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c911830e-c8d8-4371-82f2-eb52ffee8da6 None None] Network ea889acf-d9a7-46d5-8f93-62ab83c7501b requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:50:38.570978 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Router d3213dfc-948c-48f6-a78a-7e1a0a5721d5 is scheduled to L3 agent d9048829-2654-4d94-83cc-155a0884505e with binding_index 1 {{(pid=109061) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Dec 09 14:50:38.633179 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-219931e3-f098-407b-90d6-da2f284035b3 None None] Provisioning complete for port d2c041c6-719a-435f-8051-f823b16ff2d8 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:38.633728 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-219931e3-f098-407b-90d6-da2f284035b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:38.725918 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:50:38.741310 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Sync routers for ids ['d3213dfc-948c-48f6-a78a-7e1a0a5721d5'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:50:38.753810 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:38.770366 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-c8ce4263-ad06-4e00-bd6f-6dda84fa01ff admin admin] 10.222.0.39 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 2.2911620 Dec 09 14:50:38.773554 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33622) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:38.801050 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Routers {'d3213dfc-948c-48f6-a78a-7e1a0a5721d5'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:38.801700 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:50:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['d3213dfc-948c-48f6-a78a-7e1a0a5721d5'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:38.855485 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-219931e3-f098-407b-90d6-da2f284035b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:38.946416 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-219931e3-f098-407b-90d6-da2f284035b3 None None] For port d2c041c6-719a-435f-8051-f823b16ff2d8, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=d2c041c6-719a-435f-8051-f823b16ff2d8,segment=NetworkSegment(339d7547-a985-4aa6-9bcd-8bde772cd987),segment_id=339d7547-a985-4aa6-9bcd-8bde772cd987)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:38.959221 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Set router d3213dfc-948c-48f6-a78a-7e1a0a5721d5 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:38.961158 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-219931e3-f098-407b-90d6-da2f284035b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:39.124575 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-219931e3-f098-407b-90d6-da2f284035b3 None None] Pushing event updated for resources: {'Port': ['ID=d2c041c6-719a-435f-8051-f823b16ff2d8,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:39.135077 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-a1dc2593-bcf5-4857-a584-b81ab5934e84 None None] Provisioning complete for port d2c041c6-719a-435f-8051-f823b16ff2d8 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:39.135452 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-a1dc2593-bcf5-4857-a584-b81ab5934e84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:39.345915 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'name': 'tempest-TestVolumeBootPattern-587319122-router', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:36Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 3, 'project_id': '065be8eed6174ffd941b9a5500ba878c', 'gw_port': {'id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:cb:d6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:37Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:39.347938 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-16b7ea5d-4d01-4655-a509-9d50f80d1e27 req-af0fefc0-8ce2-476a-9f49-864dfa005cdc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 210 time: 0.0699713 Dec 09 14:50:39.411826 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:39.417929 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Checking router: d3213dfc-948c-48f6-a78a-7e1a0a5721d5 for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:50:39.418446 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Updating router d3213dfc-948c-48f6-a78a-7e1a0a5721d5 port 7ca0ba75-484d-4138-b03a-ffa267941846 binding host dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:50:39.442049 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-65eafa17-ddc6-4ad2-89db-5ac7f28648d7 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:39.444067 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-65eafa17-ddc6-4ad2-89db-5ac7f28648d7 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.44 "GET /v2.0/networks?id=82bc4169-86f1-48dd-b3a9-b16bd54b9d6f HTTP/1.1" status: 200 len: 809 time: 0.2855773 Dec 09 14:50:39.461533 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:39.466911 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-bc4a2c9f-9e07-4e6d-8b06-032fc0226039 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Request body: {'port': {'device_id': '1a4855db-c80c-4561-b4a2-8f21dfc11c08', 'network_id': '82bc4169-86f1-48dd-b3a9-b16bd54b9d6f', 'admin_state_up': True, 'tenant_id': 'e851ff8bfba1434b916e3a2ae6ef065b'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:39.502319 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 22aa78c6-5086-49e6-90b2-f0ea5ec6044f up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:50:39.620547 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Allocated IP 172.20.0.1 (ea889acf-d9a7-46d5-8f93-62ab83c7501b/b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7/487f04d3-d67c-4d95-9907-091d5edafbc8) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:50:39.628031 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 22aa78c6-5086-49e6-90b2-f0ea5ec6044f triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:39.628543 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:39.646168 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-bc4a2c9f-9e07-4e6d-8b06-032fc0226039 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Made reservation on behalf of e851ff8bfba1434b916e3a2ae6ef065b for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:50:39.650882 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-bc4a2c9f-9e07-4e6d-8b06-032fc0226039 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:39.766074 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:39.809295 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device d2c041c6-719a-435f-8051-f823b16ff2d8 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:50:39.809987 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:39.814833 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-bc4a2c9f-9e07-4e6d-8b06-032fc0226039 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Allocated IP 172.20.0.7 (82bc4169-86f1-48dd-b3a9-b16bd54b9d6f/b057d961-cd95-47ff-9c01-42519e40216d/34cdc4b6-76b0-4e72-9fa8-b68e3252f886) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:50:39.857715 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Network ea889acf-d9a7-46d5-8f93-62ab83c7501b is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:50:39.864458 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:50:39.869040 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:50:39.872938 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Pushing event updated for resources: {'Port': ['ID=487f04d3-d67c-4d95-9907-091d5edafbc8,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:39.892380 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Publish callbacks [] for port, precommit_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:39.910251 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:39.916406 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port d2c041c6-719a-435f-8051-f823b16ff2d8 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:39.916406 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:39.923726 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1574184'] for router_interface, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.010995 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6979dfa6-065a-4376-b9e6-41460817b5dc None None] Pushing event updated for resources: {'Port': ['ID=7ca0ba75-484d-4138-b03a-ffa267941846,revision_number=2']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:40.034458 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Attempting to bind port 7ca0ba75-484d-4138-b03a-ffa267941846 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:50:40.034823 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Attempting to bind port 7ca0ba75-484d-4138-b03a-ffa267941846 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:50:40.035183 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Attempting to bind port 7ca0ba75-484d-4138-b03a-ffa267941846 on network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:50:40.052172 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 50, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:50:40.052591 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Checking segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109063) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:50:40.053251 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.053435 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Bound using segment: {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'} {{(pid=109063) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:50:40.053974 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.managers [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Bound port: 7ca0ba75-484d-4138-b03a-ffa267941846, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'f0f2cb71-999b-4f79-9acb-b9cd907fc3ab', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c'}}] {{(pid=109063) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:50:40.054400 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.087426 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.105755 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-bc4a2c9f-9e07-4e6d-8b06-032fc0226039 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.154495 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-bc4a2c9f-9e07-4e6d-8b06-032fc0226039 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.171394 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device aabb4c34-a04c-4c90-8b7d-94b550c74426 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:50:40.173516 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] For port 7ca0ba75-484d-4138-b03a-ffa267941846, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109063) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:50:40.177296 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] For port 7ca0ba75-484d-4138-b03a-ffa267941846, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=7ca0ba75-484d-4138-b03a-ffa267941846,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109063) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:50:40.196798 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.203056 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-bc4a2c9f-9e07-4e6d-8b06-032fc0226039 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Network 82bc4169-86f1-48dd-b3a9-b16bd54b9d6f is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:50:40.206243 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-bc4a2c9f-9e07-4e6d-8b06-032fc0226039 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:50:40.209371 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-bc4a2c9f-9e07-4e6d-8b06-032fc0226039 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:50:40.244829 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc4a2c9f-9e07-4e6d-8b06-032fc0226039 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Pushing event updated for resources: {'Port': ['ID=34cdc4b6-76b0-4e72-9fa8-b68e3252f886,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:40.272250 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-bc4a2c9f-9e07-4e6d-8b06-032fc0226039 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:40.272887 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-bc4a2c9f-9e07-4e6d-8b06-032fc0226039 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.289352 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6979dfa6-065a-4376-b9e6-41460817b5dc None None] Pushing event updated for resources: {'Port': ['ID=7ca0ba75-484d-4138-b03a-ffa267941846,revision_number=3']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:40.289933 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-bc4a2c9f-9e07-4e6d-8b06-032fc0226039 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.8324199 Dec 09 14:50:40.291566 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.291911 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-6cfa7c99-ff14-4bf8-a1bc-111b41388bff None None] Provisioning complete for port 487f04d3-d67c-4d95-9907-091d5edafbc8 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:40.292260 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-6cfa7c99-ff14-4bf8-a1bc-111b41388bff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.296034 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Routers {'d3213dfc-948c-48f6-a78a-7e1a0a5721d5'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:40.296651 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:50:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['d3213dfc-948c-48f6-a78a-7e1a0a5721d5'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:40.297516 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-130461426'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.305361 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Request body: {'port': {'device_id': '1a4855db-c80c-4561-b4a2-8f21dfc11c08', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:40.363265 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port aabb4c34-a04c-4c90-8b7d-94b550c74426 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:40.363707 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.369589 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.375758 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Pushing event updated for resources: {'Port': ['ID=487f04d3-d67c-4d95-9907-091d5edafbc8,revision_number=2']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:40.379745 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-2066007', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1629368'] for router_interface, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.514906 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3e1bd13-4b34-4f2d-90a6-648a9545366f req-43d4a9dd-b75e-434e-a443-2f6dd03bedda tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:40.516525 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c3e1bd13-4b34-4f2d-90a6-648a9545366f req-43d4a9dd-b75e-434e-a443-2f6dd03bedda tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 931 time: 0.0837910 Dec 09 14:50:40.524069 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Network ea889acf-d9a7-46d5-8f93-62ab83c7501b is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:50:40.525450 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:50:40.568261 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-6cfa7c99-ff14-4bf8-a1bc-111b41388bff None None] Port 487f04d3-d67c-4d95-9907-091d5edafbc8 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:50:40.611531 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] Set router d3213dfc-948c-48f6-a78a-7e1a0a5721d5 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:40.649980 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c3e1bd13-4b34-4f2d-90a6-648a9545366f req-f2c80d9b-0c32-46f2-9c3e-0b0394d60f15 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1193717 Dec 09 14:50:40.688498 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Router d3213dfc-948c-48f6-a78a-7e1a0a5721d5 has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:50:40.689865 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:50:40.701861 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.734662 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Transition to ACTIVE for port object 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:50:40.740467 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.796060 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Pushing event updated for resources: {'Port': ['ID=34cdc4b6-76b0-4e72-9fa8-b68e3252f886,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:40.820808 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:50:40.837295 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-023f6494-2097-46cf-bd24-ba700dfdabeb admin admin] 10.222.0.39 "PUT /v2.0/routers/d3213dfc-948c-48f6-a78a-7e1a0a5721d5/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.0540600 Dec 09 14:50:40.871878 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Attempting to bind port 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:50:40.872230 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Attempting to bind port 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': '409d9627-ce84-4983-8ee7-6dc43e2a5de7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 434, 'network_id': '82bc4169-86f1-48dd-b3a9-b16bd54b9d6f'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:50:40.872557 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Attempting to bind port 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 on network 82bc4169-86f1-48dd-b3a9-b16bd54b9d6f {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:50:40.877100 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Port 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 on network 82bc4169-86f1-48dd-b3a9-b16bd54b9d6f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:50:40.877430 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Attempting to bind port 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 on network 82bc4169-86f1-48dd-b3a9-b16bd54b9d6f {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:50:40.882628 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 50, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:50:40.883056 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Checking segment: {'id': '409d9627-ce84-4983-8ee7-6dc43e2a5de7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 434, 'network_id': '82bc4169-86f1-48dd-b3a9-b16bd54b9d6f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:50:40.883488 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Bound using segment: {'id': '409d9627-ce84-4983-8ee7-6dc43e2a5de7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 434, 'network_id': '82bc4169-86f1-48dd-b3a9-b16bd54b9d6f'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:50:40.883883 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Bound port: 34cdc4b6-76b0-4e72-9fa8-b68e3252f886, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '409d9627-ce84-4983-8ee7-6dc43e2a5de7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 434, 'network_id': '82bc4169-86f1-48dd-b3a9-b16bd54b9d6f'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:50:40.884246 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.921163 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-199f89ec-c66b-4bf7-b8ea-6fc164561a10 None None] Provisioning complete for port 487f04d3-d67c-4d95-9907-091d5edafbc8 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:40.921546 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-199f89ec-c66b-4bf7-b8ea-6fc164561a10 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:40.970832 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'name': 'tempest-TestVolumeBootPattern-587319122-router', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:36Z', 'updated_at': '2021-12-09T14:50:40Z', 'revision_number': 4, 'project_id': '065be8eed6174ffd941b9a5500ba878c', 'gw_port': {'id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:cb:d6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:37Z', 'updated_at': '2021-12-09T14:50:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '487f04d3-d67c-4d95-9907-091d5edafbc8', 'name': '', 'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'mac_address': 'fa:16:3e:ef:12:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:39Z', 'updated_at': '2021-12-09T14:50:40Z', 'revision_number': 2, 'project_id': '065be8eed6174ffd941b9a5500ba878c', 'subnets': [{'id': 'b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:40.975573 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-199f89ec-c66b-4bf7-b8ea-6fc164561a10 None None] Port 487f04d3-d67c-4d95-9907-091d5edafbc8 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:50:41.006860 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7bf718ab-460c-4bce-af28-9ffa868ef61d None None] The sync data for ids ['d3213dfc-948c-48f6-a78a-7e1a0a5721d5'] in dv-cinder-819692-8-iscsi is: [{'id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'name': 'tempest-TestVolumeBootPattern-587319122-router', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:36Z', 'updated_at': '2021-12-09T14:50:40Z', 'revision_number': 4, 'project_id': '065be8eed6174ffd941b9a5500ba878c', 'gw_port': {'id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:cb:d6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:37Z', 'updated_at': '2021-12-09T14:50:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '487f04d3-d67c-4d95-9907-091d5edafbc8', 'name': '', 'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'mac_address': 'fa:16:3e:ef:12:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:39Z', 'updated_at': '2021-12-09T14:50:40Z', 'revision_number': 2, 'project_id': '065be8eed6174ffd941b9a5500ba878c', 'subnets': [{'id': 'b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:50:41.262728 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] For port 34cdc4b6-76b0-4e72-9fa8-b68e3252f886, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:50:41.266224 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] For port 34cdc4b6-76b0-4e72-9fa8-b68e3252f886, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=34cdc4b6-76b0-4e72-9fa8-b68e3252f886,segment=NetworkSegment(409d9627-ce84-4983-8ee7-6dc43e2a5de7),segment_id=409d9627-ce84-4983-8ee7-6dc43e2a5de7)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:50:41.272518 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:41.310271 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:41.311077 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:41.312930 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] 10.222.0.44 "PUT /v2.0/ports/34cdc4b6-76b0-4e72-9fa8-b68e3252f886 HTTP/1.1" status: 200 len: 1093 time: 1.0139678 Dec 09 14:50:41.313372 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1a4855db-c80c-4561-b4a2-8f21dfc11c08', 'tag': '34cdc4b6-76b0-4e72-9fa8-b68e3252f886'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:50:41.315696 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-96766202-0163-4923-a2c5-3e097fea39f6" -d '{"events": [{"name": "network-changed", "server_uuid": "1a4855db-c80c-4561-b4a2-8f21dfc11c08", "tag": "34cdc4b6-76b0-4e72-9fa8-b68e3252f886"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:50:41.338248 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5cb070a-21e1-4593-8681-001d62f5a34a service neutron] Pushing event updated for resources: {'Port': ['ID=34cdc4b6-76b0-4e72-9fa8-b68e3252f886,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:41.379872 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:50:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-407388e2-bbdd-4bbc-87e2-4e5187239d2f x-openstack-request-id: req-407388e2-bbdd-4bbc-87e2-4e5187239d2f {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:50:41.380574 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1a4855db-c80c-4561-b4a2-8f21dfc11c08", "tag": "34cdc4b6-76b0-4e72-9fa8-b68e3252f886", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:50:41.380574 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-407388e2-bbdd-4bbc-87e2-4e5187239d2f {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:50:41.381006 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1a4855db-c80c-4561-b4a2-8f21dfc11c08', 'tag': '34cdc4b6-76b0-4e72-9fa8-b68e3252f886', 'status': 'completed', 'code': 200} Dec 09 14:50:41.410398 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-db999ff3-b306-4c12-9cd3-14d30138c4d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:41.411939 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-db999ff3-b306-4c12-9cd3-14d30138c4d4 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=e851ff8bfba1434b916e3a2ae6ef065b&device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 1096 time: 0.0459526 Dec 09 14:50:41.418577 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33640) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:41.424488 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-6cf171ed-40b2-4da8-b880-8e59a3c76638 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1578162193', 'description': 'tempest-secgroup-smoke-1578162193 description', 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:41.467571 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-5a117c78-1bf1-4130-90f5-c6a3aaec59c4 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=34cdc4b6-76b0-4e72-9fa8-b68e3252f886 HTTP/1.1" status: 200 len: 217 time: 0.0466480 Dec 09 14:50:41.506150 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-6cf171ed-40b2-4da8-b880-8e59a3c76638 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:41.537013 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-265767bd-0513-4e9d-9910-c8b8d278a630 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:41.538500 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-265767bd-0513-4e9d-9910-c8b8d278a630 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=b057d961-cd95-47ff-9c01-42519e40216d HTTP/1.1" status: 200 len: 849 time: 0.0644064 Dec 09 14:50:41.579245 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-e42a292f-9e33-48ff-b97d-5b43509036f1 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=82bc4169-86f1-48dd-b3a9-b16bd54b9d6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0324113 Dec 09 14:50:41.659587 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-6cf171ed-40b2-4da8-b880-8e59a3c76638 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:41.674958 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-6cf171ed-40b2-4da8-b880-8e59a3c76638 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:41.713856 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-6cf171ed-40b2-4da8-b880-8e59a3c76638 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:41.715129 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-6cf171ed-40b2-4da8-b880-8e59a3c76638 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2955742 Dec 09 14:50:41.718315 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33646) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:41.722950 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-e417312e-3b89-49ef-9a8d-136a8bb43ba2 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Request body: {'security_group_rule': {'security_group_id': '97e4de8e-53ca-4a2a-af5b-2f037e0d4f04', 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:41.768142 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cf171ed-40b2-4da8-b880-8e59a3c76638 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'SecurityGroup': ['ID=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:41.771969 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-3d0139e9-980a-4f76-b4ab-e8926723a86f service neutron] 10.222.0.44 "GET /v2.0/networks/82bc4169-86f1-48dd-b3a9-b16bd54b9d6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1851852 Dec 09 14:50:41.775869 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e417312e-3b89-49ef-9a8d-136a8bb43ba2 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:41.841878 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c5cab7d-5499-4d0b-81b3-321475b061b4 req-9494d18a-e6b3-47bc-9d33-f0983138b53e tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:41.843567 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3c5cab7d-5499-4d0b-81b3-321475b061b4 req-9494d18a-e6b3-47bc-9d33-f0983138b53e tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 943 time: 0.0829191 Dec 09 14:50:41.868388 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e417312e-3b89-49ef-9a8d-136a8bb43ba2 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:41.877934 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e417312e-3b89-49ef-9a8d-136a8bb43ba2 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:41.882215 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b07cd57-d108-4392-82af-b7dbaff4d7c1 req-2a682d8f-881d-4dfa-bf70-963d7a3d181c service neutron] 10.222.0.44 "GET /v2.0/networks/82bc4169-86f1-48dd-b3a9-b16bd54b9d6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1023283 Dec 09 14:50:41.915711 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e417312e-3b89-49ef-9a8d-136a8bb43ba2 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=35db675c-23f2-4f98-a1c6-e5fe0dc4e4e6,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:41.924940 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e417312e-3b89-49ef-9a8d-136a8bb43ba2 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:41.926154 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-e417312e-3b89-49ef-9a8d-136a8bb43ba2 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2067728 Dec 09 14:50:41.929292 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33648) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:41.934464 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-5d3a1b24-a6d1-48d2-87b8-6cee3eb4ccef tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Request body: {'security_group_rule': {'security_group_id': '97e4de8e-53ca-4a2a-af5b-2f037e0d4f04', 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:41.943239 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3c5cab7d-5499-4d0b-81b3-321475b061b4 req-11f53bf9-a227-4271-9671-47d40fe8afd0 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0888169 Dec 09 14:50:41.995893 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96766202-0163-4923-a2c5-3e097fea39f6 req-c71cff75-c054-452b-bf0c-b8e327ba4e5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:41.997506 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-96766202-0163-4923-a2c5-3e097fea39f6 req-c71cff75-c054-452b-bf0c-b8e327ba4e5a service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=e851ff8bfba1434b916e3a2ae6ef065b&device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 1096 time: 0.0578938 Dec 09 14:50:41.998467 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5d3a1b24-a6d1-48d2-87b8-6cee3eb4ccef tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.110030 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5d3a1b24-a6d1-48d2-87b8-6cee3eb4ccef tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.116872 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5d3a1b24-a6d1-48d2-87b8-6cee3eb4ccef tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.141296 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96766202-0163-4923-a2c5-3e097fea39f6 req-4e5e9763-859d-432e-ac5b-ecd960dc4781 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:42.142769 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-96766202-0163-4923-a2c5-3e097fea39f6 req-4e5e9763-859d-432e-ac5b-ecd960dc4781 service neutron] 10.222.0.44 "GET /v2.0/networks?id=82bc4169-86f1-48dd-b3a9-b16bd54b9d6f HTTP/1.1" status: 200 len: 910 time: 0.1348433 Dec 09 14:50:42.145554 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d3a1b24-a6d1-48d2-87b8-6cee3eb4ccef tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f336a391-4c3e-47c4-970c-7f122939cc45,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:42.160788 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-5d3a1b24-a6d1-48d2-87b8-6cee3eb4ccef tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.161975 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-5d3a1b24-a6d1-48d2-87b8-6cee3eb4ccef tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2315784 Dec 09 14:50:42.165182 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 33650) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:42.170208 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-ba827738-e015-41b0-80b6-565922544f17 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Request body: {'security_group_rule': {'security_group_id': '97e4de8e-53ca-4a2a-af5b-2f037e0d4f04', 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:42.190020 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-96766202-0163-4923-a2c5-3e097fea39f6 req-49daf83a-22b4-492c-bcd9-3324d389de21 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=34cdc4b6-76b0-4e72-9fa8-b68e3252f886 HTTP/1.1" status: 200 len: 217 time: 0.0386217 Dec 09 14:50:42.203233 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ba827738-e015-41b0-80b6-565922544f17 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.244715 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96766202-0163-4923-a2c5-3e097fea39f6 req-dd7e540a-22eb-4727-8a30-e78334eada6d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:42.246637 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-96766202-0163-4923-a2c5-3e097fea39f6 req-dd7e540a-22eb-4727-8a30-e78334eada6d service neutron] 10.222.0.44 "GET /v2.0/subnets?id=b057d961-cd95-47ff-9c01-42519e40216d HTTP/1.1" status: 200 len: 849 time: 0.0487614 Dec 09 14:50:42.265633 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ba827738-e015-41b0-80b6-565922544f17 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.269735 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ba827738-e015-41b0-80b6-565922544f17 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.285610 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-96766202-0163-4923-a2c5-3e097fea39f6 req-7d208ac7-e114-42f1-998a-ec583b6ff9a1 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=82bc4169-86f1-48dd-b3a9-b16bd54b9d6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0308168 Dec 09 14:50:42.297075 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba827738-e015-41b0-80b6-565922544f17 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=74c33451-7316-4d60-9886-0acdd1165a4e,revision_number=0']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:42.311148 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-ba827738-e015-41b0-80b6-565922544f17 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.315407 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33652) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:42.315629 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-ba827738-e015-41b0-80b6-565922544f17 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1490982 Dec 09 14:50:42.320399 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-a98180a8-e365-4bf5-b0a9-73d1f7e8cac5 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Request body: {'security_group_rule': {'security_group_id': '97e4de8e-53ca-4a2a-af5b-2f037e0d4f04', 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:42.402749 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a98180a8-e365-4bf5-b0a9-73d1f7e8cac5 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.416527 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-96766202-0163-4923-a2c5-3e097fea39f6 req-5085fef6-0eda-41f8-b7fd-ec75154fa7cb service neutron] 10.222.0.44 "GET /v2.0/networks/82bc4169-86f1-48dd-b3a9-b16bd54b9d6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1215966 Dec 09 14:50:42.523850 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a98180a8-e365-4bf5-b0a9-73d1f7e8cac5 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.531957 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a98180a8-e365-4bf5-b0a9-73d1f7e8cac5 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.555848 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-96766202-0163-4923-a2c5-3e097fea39f6 req-779cf8a0-abd4-4319-8d55-56b7186fc3c8 service neutron] 10.222.0.44 "GET /v2.0/networks/82bc4169-86f1-48dd-b3a9-b16bd54b9d6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1296625 Dec 09 14:50:42.556438 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a98180a8-e365-4bf5-b0a9-73d1f7e8cac5 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=996f00a3-9a99-44a5-993c-5d5039583183,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:42.568307 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a98180a8-e365-4bf5-b0a9-73d1f7e8cac5 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.569471 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-a98180a8-e365-4bf5-b0a9-73d1f7e8cac5 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2529655 Dec 09 14:50:42.572488 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33654) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:42.576930 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-d2507490-67be-4149-af0c-ddf60d2c60cd tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Request body: {'security_group_rule': {'security_group_id': '97e4de8e-53ca-4a2a-af5b-2f037e0d4f04', 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:42.599210 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.securitygroups_db [None req-d2507490-67be-4149-af0c-ddf60d2c60cd tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Project 9e02a1db560b45ddbee50b9e57d1f4f0 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 14:50:42.604042 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d2507490-67be-4149-af0c-ddf60d2c60cd tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.664327 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d2507490-67be-4149-af0c-ddf60d2c60cd tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.670954 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d2507490-67be-4149-af0c-ddf60d2c60cd tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.693285 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2507490-67be-4149-af0c-ddf60d2c60cd tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=789b4fce-3287-48b8-a101-a592b12fd96b,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:42.703399 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-d2507490-67be-4149-af0c-ddf60d2c60cd tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.704713 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-d2507490-67be-4149-af0c-ddf60d2c60cd tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1312859 Dec 09 14:50:42.707463 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 33656) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:50:42.712212 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [None req-25fe9c99-e0c4-4ff2-9fda-6a1aa3c907db tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Request body: {'security_group_rule': {'security_group_id': '97e4de8e-53ca-4a2a-af5b-2f037e0d4f04', 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:42.736489 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.securitygroups_db [None req-25fe9c99-e0c4-4ff2-9fda-6a1aa3c907db tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Project 9e02a1db560b45ddbee50b9e57d1f4f0 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Dec 09 14:50:42.742261 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-25fe9c99-e0c4-4ff2-9fda-6a1aa3c907db tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.806671 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-25fe9c99-e0c4-4ff2-9fda-6a1aa3c907db tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.811810 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-25fe9c99-e0c4-4ff2-9fda-6a1aa3c907db tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1654491'] for security_group_rule, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.828903 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25fe9c99-e0c4-4ff2-9fda-6a1aa3c907db tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bd550fa3-58e4-4d9c-9c77-7dd38999fd9b,revision_number=0']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:42.839335 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-25fe9c99-e0c4-4ff2-9fda-6a1aa3c907db tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group_rule, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:42.840686 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-25fe9c99-e0c4-4ff2-9fda-6a1aa3c907db tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1320419 Dec 09 14:50:43.039669 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Sync routers for ids ['d3213dfc-948c-48f6-a78a-7e1a0a5721d5'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:50:43.049790 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Routers {'d3213dfc-948c-48f6-a78a-7e1a0a5721d5'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:43.050597 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:50:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['d3213dfc-948c-48f6-a78a-7e1a0a5721d5'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:43.075598 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c8b65953-5095-433d-b512-b236fad99ad2 req-213b6876-9ce6-49a8-b7fa-3c31c131f274 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:43.077278 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c8b65953-5095-433d-b512-b236fad99ad2 req-213b6876-9ce6-49a8-b7fa-3c31c131f274 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 943 time: 0.0646074 Dec 09 14:50:43.126553 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-c8b65953-5095-433d-b512-b236fad99ad2 req-91a5202d-91ba-459d-a8a5-712f79f3c032 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427871 Dec 09 14:50:43.160470 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Set router d3213dfc-948c-48f6-a78a-7e1a0a5721d5 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:43.297706 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 7ca0ba75-484d-4138-b03a-ffa267941846 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:50:43.355185 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 7ca0ba75-484d-4138-b03a-ffa267941846 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:43.355555 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:43.437108 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:43.460669 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] For port 7ca0ba75-484d-4138-b03a-ffa267941846, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=7ca0ba75-484d-4138-b03a-ffa267941846,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:43.461124 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'name': 'tempest-TestVolumeBootPattern-587319122-router', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:36Z', 'updated_at': '2021-12-09T14:50:40Z', 'revision_number': 4, 'project_id': '065be8eed6174ffd941b9a5500ba878c', 'gw_port': {'id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:cb:d6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:37Z', 'updated_at': '2021-12-09T14:50:40Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '487f04d3-d67c-4d95-9907-091d5edafbc8', 'name': '', 'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'mac_address': 'fa:16:3e:ef:12:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:39Z', 'updated_at': '2021-12-09T14:50:40Z', 'revision_number': 2, 'project_id': '065be8eed6174ffd941b9a5500ba878c', 'subnets': [{'id': 'b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:43.466198 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:43.497426 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Checking router: d3213dfc-948c-48f6-a78a-7e1a0a5721d5 for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:50:43.497859 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Updating router d3213dfc-948c-48f6-a78a-7e1a0a5721d5 port 487f04d3-d67c-4d95-9907-091d5edafbc8 binding host dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Dec 09 14:50:43.518753 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Pushing event updated for resources: {'Port': ['ID=7ca0ba75-484d-4138-b03a-ffa267941846,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:43.526638 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:43.526852 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:50:43.628096 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 34cdc4b6-76b0-4e72-9fa8-b68e3252f886, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=34cdc4b6-76b0-4e72-9fa8-b68e3252f886,segment=NetworkSegment(409d9627-ce84-4983-8ee7-6dc43e2a5de7),segment_id=409d9627-ce84-4983-8ee7-6dc43e2a5de7)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:43.639151 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': '34cdc4b6-76b0-4e72-9fa8-b68e3252f886', 'network_id': '82bc4169-86f1-48dd-b3a9-b16bd54b9d6f', 'port_id': '34cdc4b6-76b0-4e72-9fa8-b68e3252f886', 'mac_address': 'fa:16:3e:4b:e3:f3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 434, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b057d961-cd95-47ff-9c01-42519e40216d', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:50:43.676096 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:43.689579 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:50:43.710149 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 34cdc4b6-76b0-4e72-9fa8-b68e3252f886, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=34cdc4b6-76b0-4e72-9fa8-b68e3252f886,segment=NetworkSegment(409d9627-ce84-4983-8ee7-6dc43e2a5de7),segment_id=409d9627-ce84-4983-8ee7-6dc43e2a5de7)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:43.715172 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:43.763906 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=34cdc4b6-76b0-4e72-9fa8-b68e3252f886,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:43.797873 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Publish callbacks [] for port, precommit_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:43.804315 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:43.852311 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5f80fd1-b2b7-4ca7-b4e1-453c6d932f86 None None] Pushing event updated for resources: {'Port': ['ID=487f04d3-d67c-4d95-9907-091d5edafbc8,revision_number=3']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:43.914419 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Attempting to bind port 487f04d3-d67c-4d95-9907-091d5edafbc8 on host dv-cinder-819692-8-iscsi for vnic_type normal with profile {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:50:43.914785 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Attempting to bind port 487f04d3-d67c-4d95-9907-091d5edafbc8 by drivers openvswitch,hyperv on host dv-cinder-819692-8-iscsi at level 0 using segments [{'id': '339d7547-a985-4aa6-9bcd-8bde772cd987', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b'}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:50:43.915144 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Attempting to bind port 487f04d3-d67c-4d95-9907-091d5edafbc8 on network ea889acf-d9a7-46d5-8f93-62ab83c7501b {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:50:43.920914 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Checking agent: {'id': '22c2928f-b231-4a2e-88fa-0b95395f7b74', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-819692-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 35, 3), 'started_at': datetime.datetime(2021, 12, 9, 14, 35, 33), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 50, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-819692-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:50:43.920914 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Checking segment: {'id': '339d7547-a985-4aa6-9bcd-8bde772cd987', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109064) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:50:43.921366 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:43.921662 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Bound using segment: {'id': '339d7547-a985-4aa6-9bcd-8bde772cd987', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b'} {{(pid=109064) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:50:43.922133 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.managers [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Bound port: 487f04d3-d67c-4d95-9907-091d5edafbc8, host: dv-cinder-819692-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '339d7547-a985-4aa6-9bcd-8bde772cd987', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 411, 'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b'}}] {{(pid=109064) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:50:43.922529 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:43.943135 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['34cdc4b6-76b0-4e72-9fa8-b68e3252f886'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:50:43.986168 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] For port 487f04d3-d67c-4d95-9907-091d5edafbc8, host dv-cinder-819692-8-iscsi, cleared binding levels {{(pid=109064) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:50:43.989166 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.plugins.ml2.db [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] For port 487f04d3-d67c-4d95-9907-091d5edafbc8, host dv-cinder-819692-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=487f04d3-d67c-4d95-9907-091d5edafbc8,segment=NetworkSegment(339d7547-a985-4aa6-9bcd-8bde772cd987),segment_id=339d7547-a985-4aa6-9bcd-8bde772cd987)] {{(pid=109064) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:50:43.993641 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron_lib.callbacks.manager [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109064) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:44.076024 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Routers {'d3213dfc-948c-48f6-a78a-7e1a0a5721d5'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:50:44.076807 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:50:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['d3213dfc-948c-48f6-a78a-7e1a0a5721d5'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:44.112993 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5f80fd1-b2b7-4ca7-b4e1-453c6d932f86 None None] Pushing event updated for resources: {'Port': ['ID=487f04d3-d67c-4d95-9907-091d5edafbc8,revision_number=4']} {{(pid=109064) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:44.119063 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-9a21f235-719c-4129-8a72-555dd774a575 None None] Provisioning complete for port 487f04d3-d67c-4d95-9907-091d5edafbc8 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:44.119386 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-9a21f235-719c-4129-8a72-555dd774a575 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:44.207884 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] Set router d3213dfc-948c-48f6-a78a-7e1a0a5721d5 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:50:44.223187 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-9a21f235-719c-4129-8a72-555dd774a575 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:44.274526 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-9a21f235-719c-4129-8a72-555dd774a575 None None] For port 487f04d3-d67c-4d95-9907-091d5edafbc8, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=487f04d3-d67c-4d95-9907-091d5edafbc8,segment=NetworkSegment(339d7547-a985-4aa6-9bcd-8bde772cd987),segment_id=339d7547-a985-4aa6-9bcd-8bde772cd987)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:44.280714 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-9a21f235-719c-4129-8a72-555dd774a575 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:44.287377 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6d772c28-b368-49b5-9419-b679fec4db6f req-dd2c6f53-a7a6-44ff-964f-6bc43d97f2ce tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:44.289153 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6d772c28-b368-49b5-9419-b679fec4db6f req-dd2c6f53-a7a6-44ff-964f-6bc43d97f2ce tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 944 time: 0.0576575 Dec 09 14:50:44.334886 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a21f235-719c-4129-8a72-555dd774a575 None None] Pushing event updated for resources: {'Port': ['ID=487f04d3-d67c-4d95-9907-091d5edafbc8,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:44.348521 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6d772c28-b368-49b5-9419-b679fec4db6f req-02724a3d-b2c1-4f6e-992c-b38295c3813b tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0482132 Dec 09 14:50:44.400326 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-235f206b-ea94-44eb-8b3a-70e7c0e3862c None None] Provisioning complete for port 487f04d3-d67c-4d95-9907-091d5edafbc8 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:44.400867 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-235f206b-ea94-44eb-8b3a-70e7c0e3862c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:44.447552 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'name': 'tempest-TestVolumeBootPattern-587319122-router', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:36Z', 'updated_at': '2021-12-09T14:50:40Z', 'revision_number': 4, 'project_id': '065be8eed6174ffd941b9a5500ba878c', 'gw_port': {'id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:cb:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:37Z', 'updated_at': '2021-12-09T14:50:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '487f04d3-d67c-4d95-9907-091d5edafbc8', 'name': '', 'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'mac_address': 'fa:16:3e:ef:12:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:39Z', 'updated_at': '2021-12-09T14:50:43Z', 'revision_number': 4, 'project_id': '065be8eed6174ffd941b9a5500ba878c', 'subnets': [{'id': 'b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:50:44.474092 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d5052e0a-cf11-4628-92c4-083ffa534dd2 None None] The sync data for ids ['d3213dfc-948c-48f6-a78a-7e1a0a5721d5'] in dv-cinder-819692-8-iscsi is: [{'id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'name': 'tempest-TestVolumeBootPattern-587319122-router', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:36Z', 'updated_at': '2021-12-09T14:50:40Z', 'revision_number': 4, 'project_id': '065be8eed6174ffd941b9a5500ba878c', 'gw_port': {'id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:cb:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:37Z', 'updated_at': '2021-12-09T14:50:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': '487f04d3-d67c-4d95-9907-091d5edafbc8', 'name': '', 'network_id': 'ea889acf-d9a7-46d5-8f93-62ab83c7501b', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'mac_address': 'fa:16:3e:ef:12:82', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'device_owner': 'network:router_interface', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': 'b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:39Z', 'updated_at': '2021-12-09T14:50:43Z', 'revision_number': 4, 'project_id': '065be8eed6174ffd941b9a5500ba878c', 'subnets': [{'id': 'b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:50:44.847016 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:45.291409 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 7ca0ba75-484d-4138-b03a-ffa267941846 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:50:45.351012 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 7ca0ba75-484d-4138-b03a-ffa267941846 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:45.351545 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:45.438833 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 487f04d3-d67c-4d95-9907-091d5edafbc8 up at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:50:45.468045 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66cf8d7a-05fd-4ef6-8b8d-8b3638a2bf16 req-481203e5-b949-4c4d-9138-95e988934fb1 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:45.469762 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-66cf8d7a-05fd-4ef6-8b8d-8b3638a2bf16 req-481203e5-b949-4c4d-9138-95e988934fb1 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 944 time: 0.0507805 Dec 09 14:50:45.486966 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Provisioning complete for port 487f04d3-d67c-4d95-9907-091d5edafbc8 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:45.487341 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:45.527224 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-66cf8d7a-05fd-4ef6-8b8d-8b3638a2bf16 req-d719fe24-fd95-41a8-9081-148cd3efda16 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0489311 Dec 09 14:50:45.550248 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:50:45.618165 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:50:45.624616 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:45.624975 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:45.705839 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:45.731021 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1a4855db-c80c-4561-b4a2-8f21dfc11c08', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '34cdc4b6-76b0-4e72-9fa8-b68e3252f886'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:50:45.733573 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8a788d85-a3b6-426d-89e8-6f159d62aa5c" -d '{"events": [{"server_uuid": "1a4855db-c80c-4561-b4a2-8f21dfc11c08", "name": "network-vif-plugged", "status": "completed", "tag": "34cdc4b6-76b0-4e72-9fa8-b68e3252f886"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:50:45.747643 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 34cdc4b6-76b0-4e72-9fa8-b68e3252f886, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=34cdc4b6-76b0-4e72-9fa8-b68e3252f886,segment=NetworkSegment(409d9627-ce84-4983-8ee7-6dc43e2a5de7),segment_id=409d9627-ce84-4983-8ee7-6dc43e2a5de7)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:45.753210 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:45.776994 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:50:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b78387cd-443d-44b3-ac05-d09ac6f44720 x-openstack-request-id: req-b78387cd-443d-44b3-ac05-d09ac6f44720 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:50:45.777290 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1a4855db-c80c-4561-b4a2-8f21dfc11c08", "name": "network-vif-plugged", "status": "completed", "tag": "34cdc4b6-76b0-4e72-9fa8-b68e3252f886", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:50:45.777536 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-b78387cd-443d-44b3-ac05-d09ac6f44720 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:50:45.777933 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1a4855db-c80c-4561-b4a2-8f21dfc11c08', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '34cdc4b6-76b0-4e72-9fa8-b68e3252f886', 'code': 200} Dec 09 14:50:45.808709 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=34cdc4b6-76b0-4e72-9fa8-b68e3252f886,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:45.946781 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05f1251e-524c-4335-8ea4-6856ebbce238 req-0467e327-3499-421f-b98f-beca345bfa37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:45.948874 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-05f1251e-524c-4335-8ea4-6856ebbce238 req-0467e327-3499-421f-b98f-beca345bfa37 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 1098 time: 0.0409410 Dec 09 14:50:45.997611 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-05f1251e-524c-4335-8ea4-6856ebbce238 req-d69c1ef5-3d67-4c34-a222-b3e301033e6e service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410862 Dec 09 14:50:46.655435 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25d2f8c4-f7b5-48c4-8a28-5f9138807e5c req-68568a90-4d5c-4459-ad87-c9dc156aca84 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:46.656955 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-25d2f8c4-f7b5-48c4-8a28-5f9138807e5c req-68568a90-4d5c-4459-ad87-c9dc156aca84 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 945 time: 0.0618284 Dec 09 14:50:46.707743 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-25d2f8c4-f7b5-48c4-8a28-5f9138807e5c req-363d1b38-e0b9-4975-a394-3749bf690b84 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445714 Dec 09 14:50:47.836831 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1b6c6e8-58a7-47f8-89e3-946507084039 req-61000cf0-a31f-4938-85ad-a8f5b1f9fe95 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:47.840186 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f1b6c6e8-58a7-47f8-89e3-946507084039 req-61000cf0-a31f-4938-85ad-a8f5b1f9fe95 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 945 time: 0.0538318 Dec 09 14:50:47.888303 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f1b6c6e8-58a7-47f8-89e3-946507084039 req-7b4609bf-b6e1-45ff-b3cc-d43b411d809e tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432286 Dec 09 14:50:48.577521 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce8626b4-6547-43ad-9f2d-143d6773a9cb req-7813eeee-e9c7-46a9-8cd8-1831c4279b8d tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:48.579008 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ce8626b4-6547-43ad-9f2d-143d6773a9cb req-7813eeee-e9c7-46a9-8cd8-1831c4279b8d tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 945 time: 0.0533843 Dec 09 14:50:48.630787 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-ce8626b4-6547-43ad-9f2d-143d6773a9cb req-192069e2-5402-43d9-9f9c-104f27ef7f9c tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427322 Dec 09 14:50:49.764514 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e051d60d-281f-47e0-8f8c-015578c62b81 req-73fe5d7c-a8b0-4e35-979c-856c32c809c1 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:49.766096 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e051d60d-281f-47e0-8f8c-015578c62b81 req-73fe5d7c-a8b0-4e35-979c-856c32c809c1 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 945 time: 0.0618505 Dec 09 14:50:49.819531 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e051d60d-281f-47e0-8f8c-015578c62b81 req-309e05d4-6460-412f-b2ef-fbe502f54105 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470939 Dec 09 14:50:49.979462 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8367852e-e385-4efc-93e6-cbf8afd9a650 req-eb656ad8-8809-4590-b053-a8596a695f38 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:49.980884 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8367852e-e385-4efc-93e6-cbf8afd9a650 req-eb656ad8-8809-4590-b053-a8596a695f38 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.44 "GET /v2.0/ports?device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 945 time: 0.0641370 Dec 09 14:50:50.081079 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-8367852e-e385-4efc-93e6-cbf8afd9a650 req-88f20972-6590-4796-b2f7-5de961cae884 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Deleting port 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:50:50.081419 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-8367852e-e385-4efc-93e6-cbf8afd9a650 req-88f20972-6590-4796-b2f7-5de961cae884 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:50.173120 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-8367852e-e385-4efc-93e6-cbf8afd9a650 req-88f20972-6590-4796-b2f7-5de961cae884 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] For port 34cdc4b6-76b0-4e72-9fa8-b68e3252f886, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=34cdc4b6-76b0-4e72-9fa8-b68e3252f886,segment=NetworkSegment(409d9627-ce84-4983-8ee7-6dc43e2a5de7),segment_id=409d9627-ce84-4983-8ee7-6dc43e2a5de7)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:50.173435 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-8367852e-e385-4efc-93e6-cbf8afd9a650 req-88f20972-6590-4796-b2f7-5de961cae884 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:50.187078 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-8367852e-e385-4efc-93e6-cbf8afd9a650 req-88f20972-6590-4796-b2f7-5de961cae884 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Calling delete_port for 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:50:50.332190 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-8367852e-e385-4efc-93e6-cbf8afd9a650 req-88f20972-6590-4796-b2f7-5de961cae884 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:50.344949 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['34cdc4b6-76b0-4e72-9fa8-b68e3252f886'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:50:50.373623 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88f20972-6590-4796-b2f7-5de961cae884 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Pushing event deleted for resources: {'Port': ['ID=34cdc4b6-76b0-4e72-9fa8-b68e3252f886,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:50.406294 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-8367852e-e385-4efc-93e6-cbf8afd9a650 req-88f20972-6590-4796-b2f7-5de961cae884 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] No DVR routers for this DVR port 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:50:50.409195 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-8367852e-e385-4efc-93e6-cbf8afd9a650 req-88f20972-6590-4796-b2f7-5de961cae884 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:50.412549 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8367852e-e385-4efc-93e6-cbf8afd9a650 req-88f20972-6590-4796-b2f7-5de961cae884 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.44 "DELETE /v2.0/ports/34cdc4b6-76b0-4e72-9fa8-b68e3252f886 HTTP/1.1" status: 204 len: 173 time: 0.4248526 Dec 09 14:50:50.412991 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1a4855db-c80c-4561-b4a2-8f21dfc11c08', 'name': 'network-vif-deleted', 'tag': '34cdc4b6-76b0-4e72-9fa8-b68e3252f886'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:50:50.415260 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d8b8fdd7-2135-4e9d-952c-6d3485b0354b" -d '{"events": [{"server_uuid": "1a4855db-c80c-4561-b4a2-8f21dfc11c08", "name": "network-vif-deleted", "tag": "34cdc4b6-76b0-4e72-9fa8-b68e3252f886"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:50:50.442624 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:50:50.458308 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:50:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c38f6add-285c-4b34-8a1a-e0d947978d3b x-openstack-request-id: req-c38f6add-285c-4b34-8a1a-e0d947978d3b {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:50:50.458596 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1a4855db-c80c-4561-b4a2-8f21dfc11c08", "name": "network-vif-deleted", "tag": "34cdc4b6-76b0-4e72-9fa8-b68e3252f886", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:50:50.458856 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-c38f6add-285c-4b34-8a1a-e0d947978d3b {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:50:50.459416 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1a4855db-c80c-4561-b4a2-8f21dfc11c08', 'name': 'network-vif-deleted', 'tag': '34cdc4b6-76b0-4e72-9fa8-b68e3252f886', 'status': 'completed', 'code': 200} Dec 09 14:50:50.938276 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2a2ae4ed-88bc-450d-bd57-c940210192ee req-d6687d32-12ec-4d5d-9e38-362f534fb074 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=1a4855db-c80c-4561-b4a2-8f21dfc11c08 HTTP/1.1" status: 200 len: 210 time: 0.0331376 Dec 09 14:50:52.217755 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-1963c616-4576-44a0-9679-2b465cf118a4 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:52.219134 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-1963c616-4576-44a0-9679-2b465cf118a4 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/networks?id=82bc4169-86f1-48dd-b3a9-b16bd54b9d6f HTTP/1.1" status: 200 len: 809 time: 0.1024539 Dec 09 14:50:52.237773 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-909f7ddd-2f7b-4e21-b2f0-b24d73af07ed tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/quotas/e851ff8bfba1434b916e3a2ae6ef065b HTTP/1.1" status: 200 len: 375 time: 0.0117900 Dec 09 14:50:52.275149 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-b95532eb-2821-4ade-ae3e-3b2873336927 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=e851ff8bfba1434b916e3a2ae6ef065b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0281971 Dec 09 14:50:52.366447 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-f5e24fbc-8fff-4f76-83f3-f50b0bbf9881 service neutron] 10.222.0.39 "GET /v2.0/networks/82bc4169-86f1-48dd-b3a9-b16bd54b9d6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868227 Dec 09 14:50:52.462141 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-381e46b3-54a4-43e8-a71e-71e33ee90fcf service neutron] 10.222.0.39 "GET /v2.0/networks/82bc4169-86f1-48dd-b3a9-b16bd54b9d6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0890651 Dec 09 14:50:52.628924 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-017e7232-22d7-4707-bd9f-cb677f9798ce req-7d18cb0d-5d3a-4305-adde-5572f65f1cee tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 210 time: 0.0264959 Dec 09 14:50:53.593459 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:50:53.603147 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-975176e6-411d-41e7-9220-46e5165367b8 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:53.604676 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-975176e6-411d-41e7-9220-46e5165367b8 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.44 "GET /v2.0/networks?id=82bc4169-86f1-48dd-b3a9-b16bd54b9d6f HTTP/1.1" status: 200 len: 809 time: 0.1080759 Dec 09 14:50:53.616480 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:50:53.616833 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 34cdc4b6-76b0-4e72-9fa8-b68e3252f886 not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:50:53.620645 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-e5d67975-2c50-49ef-b53e-4b86d7ece9bc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Request body: {'port': {'device_id': '0c2a72ba-e05e-4dc9-9ed2-aa763085888d', 'network_id': '82bc4169-86f1-48dd-b3a9-b16bd54b9d6f', 'admin_state_up': True, 'tenant_id': 'e851ff8bfba1434b916e3a2ae6ef065b'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:53.744053 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-071828e4-9b56-4b80-892c-5321587cb67c req-102022bc-1fa4-475a-b96a-1c2d563d595e tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 210 time: 0.0405488 Dec 09 14:50:53.768787 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-e5d67975-2c50-49ef-b53e-4b86d7ece9bc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Made reservation on behalf of e851ff8bfba1434b916e3a2ae6ef065b for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:50:53.772557 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-e5d67975-2c50-49ef-b53e-4b86d7ece9bc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:53.897447 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-e5d67975-2c50-49ef-b53e-4b86d7ece9bc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Allocated IP 172.20.0.12 (82bc4169-86f1-48dd-b3a9-b16bd54b9d6f/b057d961-cd95-47ff-9c01-42519e40216d/7c005908-a50e-4407-8228-1cab79ee9190) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:50:54.050421 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-e5d67975-2c50-49ef-b53e-4b86d7ece9bc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:54.098884 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-e5d67975-2c50-49ef-b53e-4b86d7ece9bc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:54.142297 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-e5d67975-2c50-49ef-b53e-4b86d7ece9bc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Network 82bc4169-86f1-48dd-b3a9-b16bd54b9d6f is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:50:54.147831 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-e5d67975-2c50-49ef-b53e-4b86d7ece9bc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:50:54.151436 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-e5d67975-2c50-49ef-b53e-4b86d7ece9bc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:50:54.158015 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5d67975-2c50-49ef-b53e-4b86d7ece9bc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Pushing event updated for resources: {'Port': ['ID=7c005908-a50e-4407-8228-1cab79ee9190,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:54.207877 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-e5d67975-2c50-49ef-b53e-4b86d7ece9bc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:54.208504 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-e5d67975-2c50-49ef-b53e-4b86d7ece9bc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:54.225431 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-e5d67975-2c50-49ef-b53e-4b86d7ece9bc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6109927 Dec 09 14:50:54.238802 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Request body: {'port': {'device_id': '0c2a72ba-e05e-4dc9-9ed2-aa763085888d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:50:54.292918 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:54.560411 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 7c005908-a50e-4407-8228-1cab79ee9190 {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:50:54.568132 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:54.580386 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Transition to ACTIVE for port object 7c005908-a50e-4407-8228-1cab79ee9190 will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:50:54.586371 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:54.637259 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Pushing event updated for resources: {'Port': ['ID=7c005908-a50e-4407-8228-1cab79ee9190,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:54.706844 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Attempting to bind port 7c005908-a50e-4407-8228-1cab79ee9190 on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:50:54.707195 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Attempting to bind port 7c005908-a50e-4407-8228-1cab79ee9190 by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': '409d9627-ce84-4983-8ee7-6dc43e2a5de7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 434, 'network_id': '82bc4169-86f1-48dd-b3a9-b16bd54b9d6f'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:50:54.707571 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Attempting to bind port 7c005908-a50e-4407-8228-1cab79ee9190 on network 82bc4169-86f1-48dd-b3a9-b16bd54b9d6f {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:50:54.712226 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Port 7c005908-a50e-4407-8228-1cab79ee9190 on network 82bc4169-86f1-48dd-b3a9-b16bd54b9d6f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:50:54.712605 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Attempting to bind port 7c005908-a50e-4407-8228-1cab79ee9190 on network 82bc4169-86f1-48dd-b3a9-b16bd54b9d6f {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:50:54.717838 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 50, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:50:54.718185 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Checking segment: {'id': '409d9627-ce84-4983-8ee7-6dc43e2a5de7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 434, 'network_id': '82bc4169-86f1-48dd-b3a9-b16bd54b9d6f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:50:54.718613 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Bound using segment: {'id': '409d9627-ce84-4983-8ee7-6dc43e2a5de7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 434, 'network_id': '82bc4169-86f1-48dd-b3a9-b16bd54b9d6f'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:50:54.719062 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Bound port: 7c005908-a50e-4407-8228-1cab79ee9190, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '409d9627-ce84-4983-8ee7-6dc43e2a5de7', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 434, 'network_id': '82bc4169-86f1-48dd-b3a9-b16bd54b9d6f'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:50:54.719439 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:54.785035 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] For port 7c005908-a50e-4407-8228-1cab79ee9190, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:50:54.788377 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] For port 7c005908-a50e-4407-8228-1cab79ee9190, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=7c005908-a50e-4407-8228-1cab79ee9190,segment=NetworkSegment(409d9627-ce84-4983-8ee7-6dc43e2a5de7),segment_id=409d9627-ce84-4983-8ee7-6dc43e2a5de7)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:50:54.793610 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:54.829488 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:54.830142 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:54.831537 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] 10.222.0.44 "PUT /v2.0/ports/7c005908-a50e-4407-8228-1cab79ee9190 HTTP/1.1" status: 200 len: 1094 time: 0.5969391 Dec 09 14:50:54.831999 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0c2a72ba-e05e-4dc9-9ed2-aa763085888d', 'tag': '7c005908-a50e-4407-8228-1cab79ee9190'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:50:54.834281 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9d1e2c4a-494a-4c46-8966-a2dc52cb98e1" -d '{"events": [{"name": "network-changed", "server_uuid": "0c2a72ba-e05e-4dc9-9ed2-aa763085888d", "tag": "7c005908-a50e-4407-8228-1cab79ee9190"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:50:54.859692 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abe2e147-cd5a-419e-8fb4-30f3da5e7534 service neutron] Pushing event updated for resources: {'Port': ['ID=7c005908-a50e-4407-8228-1cab79ee9190,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:54.859897 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e265b0f-9402-4304-8f55-3ce4d8450478 req-c6718994-1457-441e-861f-e600b7e665b2 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:54.867147 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3e265b0f-9402-4304-8f55-3ce4d8450478 req-c6718994-1457-441e-861f-e600b7e665b2 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 944 time: 0.0544884 Dec 09 14:50:54.894706 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:50:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-52e10019-c6b2-4670-aac6-b1b1bfc43910 x-openstack-request-id: req-52e10019-c6b2-4670-aac6-b1b1bfc43910 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:50:54.895157 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0c2a72ba-e05e-4dc9-9ed2-aa763085888d", "tag": "7c005908-a50e-4407-8228-1cab79ee9190", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:50:54.895477 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-52e10019-c6b2-4670-aac6-b1b1bfc43910 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:50:54.896043 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0c2a72ba-e05e-4dc9-9ed2-aa763085888d', 'tag': '7c005908-a50e-4407-8228-1cab79ee9190', 'status': 'completed', 'code': 200} Dec 09 14:50:54.911484 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3e265b0f-9402-4304-8f55-3ce4d8450478 req-b641ed88-7ebf-4823-bd04-6ed878544f99 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434587 Dec 09 14:50:54.930379 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-0252c214-abba-4a7c-bee0-f8997b03b30e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:54.931913 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-0252c214-abba-4a7c-bee0-f8997b03b30e service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=e851ff8bfba1434b916e3a2ae6ef065b&device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 1097 time: 0.0470362 Dec 09 14:50:54.974102 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-d30a70d1-afa5-420a-975e-0542317032a8 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7c005908-a50e-4407-8228-1cab79ee9190 HTTP/1.1" status: 200 len: 217 time: 0.0335891 Dec 09 14:50:55.028431 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-9e551d75-f4cb-4494-9639-84dcdec95c60 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:55.029777 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-9e551d75-f4cb-4494-9639-84dcdec95c60 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=b057d961-cd95-47ff-9c01-42519e40216d HTTP/1.1" status: 200 len: 849 time: 0.0468585 Dec 09 14:50:55.064286 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-72ab261d-a38d-4e3f-bddb-cb258c846615 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=82bc4169-86f1-48dd-b3a9-b16bd54b9d6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0238650 Dec 09 14:50:55.157933 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-88235103-088f-4d45-95a9-1e860681becb service neutron] 10.222.0.44 "GET /v2.0/networks/82bc4169-86f1-48dd-b3a9-b16bd54b9d6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851738 Dec 09 14:50:55.255681 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-33140cc3-b098-4f7e-bf1d-b977d6de1d01 req-a8e32b72-49ff-4e1d-afce-4423d161b2ab service neutron] 10.222.0.44 "GET /v2.0/networks/82bc4169-86f1-48dd-b3a9-b16bd54b9d6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0893347 Dec 09 14:50:55.349912 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d1e2c4a-494a-4c46-8966-a2dc52cb98e1 req-b306a7eb-cbc2-43a5-be7b-859109a0b2d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:55.351287 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d1e2c4a-494a-4c46-8966-a2dc52cb98e1 req-b306a7eb-cbc2-43a5-be7b-859109a0b2d2 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=e851ff8bfba1434b916e3a2ae6ef065b&device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 1097 time: 0.0420268 Dec 09 14:50:55.443352 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d1e2c4a-494a-4c46-8966-a2dc52cb98e1 req-308506f2-e2eb-41d8-86cb-eeb61f89b93b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:55.444844 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d1e2c4a-494a-4c46-8966-a2dc52cb98e1 req-308506f2-e2eb-41d8-86cb-eeb61f89b93b service neutron] 10.222.0.44 "GET /v2.0/networks?id=82bc4169-86f1-48dd-b3a9-b16bd54b9d6f HTTP/1.1" status: 200 len: 910 time: 0.0860422 Dec 09 14:50:55.493767 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d1e2c4a-494a-4c46-8966-a2dc52cb98e1 req-92936a98-5512-439f-b6f0-be27f90f8fa7 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=7c005908-a50e-4407-8228-1cab79ee9190 HTTP/1.1" status: 200 len: 217 time: 0.0399220 Dec 09 14:50:55.542972 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d1e2c4a-494a-4c46-8966-a2dc52cb98e1 req-ebada767-f59f-4ead-b662-c940f0db1a85 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:55.544496 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d1e2c4a-494a-4c46-8966-a2dc52cb98e1 req-ebada767-f59f-4ead-b662-c940f0db1a85 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=b057d961-cd95-47ff-9c01-42519e40216d HTTP/1.1" status: 200 len: 849 time: 0.0430634 Dec 09 14:50:55.578096 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d1e2c4a-494a-4c46-8966-a2dc52cb98e1 req-1931425a-1806-4a50-8dbd-8e85b75ee8c7 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=82bc4169-86f1-48dd-b3a9-b16bd54b9d6f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0244203 Dec 09 14:50:55.671563 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d1e2c4a-494a-4c46-8966-a2dc52cb98e1 req-1ed1fff7-3ef3-486f-be31-293c068ef735 service neutron] 10.222.0.44 "GET /v2.0/networks/82bc4169-86f1-48dd-b3a9-b16bd54b9d6f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849512 Dec 09 14:50:55.764743 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d1e2c4a-494a-4c46-8966-a2dc52cb98e1 req-01524695-a5db-4475-9557-1cf95af8a3df service neutron] 10.222.0.44 "GET /v2.0/networks/82bc4169-86f1-48dd-b3a9-b16bd54b9d6f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0855229 Dec 09 14:50:56.053801 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b1f7446-12da-4b58-9295-e90676befa46 req-2ecdb4d6-8895-43c1-a43a-dd87a2c64737 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:56.055315 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b1f7446-12da-4b58-9295-e90676befa46 req-2ecdb4d6-8895-43c1-a43a-dd87a2c64737 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 944 time: 0.0669065 Dec 09 14:50:56.105657 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-8b1f7446-12da-4b58-9295-e90676befa46 req-f0063507-0ed2-46fe-bc66-ed6fff3f3ac3 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417509 Dec 09 14:50:57.019375 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-10f99d95-1048-45f7-a3e4-6dc3b21bbdac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:57.234474 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd03a6dd-7a99-41cf-b42c-8e0ddebcf993 req-44157490-9f2f-4ab8-bf20-3924b341703b tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:57.236000 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-cd03a6dd-7a99-41cf-b42c-8e0ddebcf993 req-44157490-9f2f-4ab8-bf20-3924b341703b tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 944 time: 0.0547764 Dec 09 14:50:57.284856 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-cd03a6dd-7a99-41cf-b42c-8e0ddebcf993 req-7dd0d36c-35d7-4896-8427-82e51bfc1873 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425508 Dec 09 14:50:57.649183 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 7c005908-a50e-4407-8228-1cab79ee9190 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:50:57.749150 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 7c005908-a50e-4407-8228-1cab79ee9190, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=7c005908-a50e-4407-8228-1cab79ee9190,segment=NetworkSegment(409d9627-ce84-4983-8ee7-6dc43e2a5de7),segment_id=409d9627-ce84-4983-8ee7-6dc43e2a5de7)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:57.760528 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': '7c005908-a50e-4407-8228-1cab79ee9190', 'network_id': '82bc4169-86f1-48dd-b3a9-b16bd54b9d6f', 'port_id': '7c005908-a50e-4407-8228-1cab79ee9190', 'mac_address': 'fa:16:3e:2f:8b:2a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 434, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b057d961-cd95-47ff-9c01-42519e40216d', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:50:57.811633 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:57.826312 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 7c005908-a50e-4407-8228-1cab79ee9190 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:50:57.846055 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 7c005908-a50e-4407-8228-1cab79ee9190, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=7c005908-a50e-4407-8228-1cab79ee9190,segment=NetworkSegment(409d9627-ce84-4983-8ee7-6dc43e2a5de7),segment_id=409d9627-ce84-4983-8ee7-6dc43e2a5de7)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:57.852451 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:57.902192 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=7c005908-a50e-4407-8228-1cab79ee9190,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:50:58.113952 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['7c005908-a50e-4407-8228-1cab79ee9190'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:50:58.409579 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbea4812-2128-4421-81c2-6f23eb1262d6 req-82068943-589b-46d7-81e5-f268be565352 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:58.411115 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bbea4812-2128-4421-81c2-6f23eb1262d6 req-82068943-589b-46d7-81e5-f268be565352 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 945 time: 0.0559561 Dec 09 14:50:58.459273 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bbea4812-2128-4421-81c2-6f23eb1262d6 req-89f32081-5515-4c9f-973c-a66885dc01ec tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421758 Dec 09 14:50:59.192980 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-648af7d3-2295-4396-95ff-175588ed9c24 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:59.586383 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fbc9efde-d829-4790-a052-2042c6071a5c req-5762ab06-a462-4ac1-9b25-5cfbe2d1e92e tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:50:59.587947 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fbc9efde-d829-4790-a052-2042c6071a5c req-5762ab06-a462-4ac1-9b25-5cfbe2d1e92e tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 945 time: 0.0547132 Dec 09 14:50:59.636492 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fbc9efde-d829-4790-a052-2042c6071a5c req-0cb263a1-7080-497e-95d8-7953862b4547 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424120 Dec 09 14:50:59.666751 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 7c005908-a50e-4407-8228-1cab79ee9190 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:50:59.721033 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port 7c005908-a50e-4407-8228-1cab79ee9190 completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:50:59.725189 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port 7c005908-a50e-4407-8228-1cab79ee9190 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:50:59.725539 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:59.814448 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:59.837597 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c2a72ba-e05e-4dc9-9ed2-aa763085888d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7c005908-a50e-4407-8228-1cab79ee9190'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:50:59.839913 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-883969f7-aabd-4c8f-a8b1-3a790ef51591" -d '{"events": [{"server_uuid": "0c2a72ba-e05e-4dc9-9ed2-aa763085888d", "name": "network-vif-plugged", "status": "completed", "tag": "7c005908-a50e-4407-8228-1cab79ee9190"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:50:59.852882 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 7c005908-a50e-4407-8228-1cab79ee9190, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=7c005908-a50e-4407-8228-1cab79ee9190,segment=NetworkSegment(409d9627-ce84-4983-8ee7-6dc43e2a5de7),segment_id=409d9627-ce84-4983-8ee7-6dc43e2a5de7)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:50:59.859087 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:50:59.884300 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:50:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ad996b32-b5b8-4c87-96b0-df041b5231e3 x-openstack-request-id: req-ad996b32-b5b8-4c87-96b0-df041b5231e3 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:50:59.884572 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0c2a72ba-e05e-4dc9-9ed2-aa763085888d", "name": "network-vif-plugged", "status": "completed", "tag": "7c005908-a50e-4407-8228-1cab79ee9190", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:50:59.884820 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-ad996b32-b5b8-4c87-96b0-df041b5231e3 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:50:59.885208 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c2a72ba-e05e-4dc9-9ed2-aa763085888d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '7c005908-a50e-4407-8228-1cab79ee9190', 'code': 200} Dec 09 14:50:59.919543 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=7c005908-a50e-4407-8228-1cab79ee9190,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:51:00.075840 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d53132a-ded4-401c-aa03-985272583264 req-dcbcf796-ad40-4b71-99c7-11e4889afcf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:00.077324 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d53132a-ded4-401c-aa03-985272583264 req-dcbcf796-ad40-4b71-99c7-11e4889afcf8 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 1099 time: 0.0436184 Dec 09 14:51:00.129765 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d53132a-ded4-401c-aa03-985272583264 req-fb01c8ba-f5c5-4653-aa6a-0103a99accbc service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400951 Dec 09 14:51:00.454891 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:00.765536 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5332d3ba-57a5-4848-b295-5d3b9308f275 req-00aef714-599a-4b2e-bd03-7a9692b16c5f tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:00.766976 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5332d3ba-57a5-4848-b295-5d3b9308f275 req-00aef714-599a-4b2e-bd03-7a9692b16c5f tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 946 time: 0.0489316 Dec 09 14:51:00.818440 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5332d3ba-57a5-4848-b295-5d3b9308f275 req-1439b06a-b0d3-4a50-bc28-aba623136ef2 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453186 Dec 09 14:51:01.315750 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-6829c2fd-f5ed-4c3c-9a1b-f689be72347b tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1578162193&fields=id&tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0 HTTP/1.1" status: 200 len: 267 time: 0.0538206 Dec 09 14:51:01.422562 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-e8b5396c-7971-409f-8ecf-c775c5cd313b tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:01.424127 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-e8b5396c-7971-409f-8ecf-c775c5cd313b tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 812 time: 0.1012754 Dec 09 14:51:01.442491 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-8e2c9fa3-7ee3-436d-98ba-cfd088b9a1be tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/quotas/9e02a1db560b45ddbee50b9e57d1f4f0 HTTP/1.1" status: 200 len: 375 time: 0.0095928 Dec 09 14:51:01.498396 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-ce242e72-bb33-4c03-be47-80cfeeeb3fb2 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0501707 Dec 09 14:51:01.599096 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-78c2a59b-c54d-4530-ba33-5c38bb015301 service neutron] 10.222.0.39 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0878298 Dec 09 14:51:01.705147 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-e961fc74-677b-42fc-b8cb-6cc552986b4b service neutron] 10.222.0.39 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0965643 Dec 09 14:51:01.822153 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:01.941602 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1ffc994-6bc1-4c97-92d7-b223c2f35e52 req-102f737d-fc8f-4e36-9462-9a627c0400a3 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:01.943205 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d1ffc994-6bc1-4c97-92d7-b223c2f35e52 req-102f737d-fc8f-4e36-9462-9a627c0400a3 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 946 time: 0.0503483 Dec 09 14:51:01.996345 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d1ffc994-6bc1-4c97-92d7-b223c2f35e52 req-a5d0dbfe-1dd0-44fc-b10a-0e16c3055c32 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464525 Dec 09 14:51:02.026476 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bd7b1c8f-28e4-4431-83b8-eb64985b4a8c req-8ce47e83-78f4-49a8-a970-30233ac7f3a8 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 210 time: 0.0335336 Dec 09 14:51:02.602362 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:02.635115 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95ce417e-3877-41c6-a8ca-ec8c0ec4587a req-6e6894b9-688d-4de9-bc7f-c53ec99d9873 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:02.636743 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-95ce417e-3877-41c6-a8ca-ec8c0ec4587a req-6e6894b9-688d-4de9-bc7f-c53ec99d9873 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 946 time: 0.0515735 Dec 09 14:51:02.687820 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-95ce417e-3877-41c6-a8ca-ec8c0ec4587a req-2da4d264-6c60-4af9-9ed3-e8ecb4969b4d tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446618 Dec 09 14:51:03.139417 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-23c082b0-136d-4312-a85f-686a06399aa0 req-144746fa-fdf1-4a88-817b-db76238c42b1 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 210 time: 0.0289156 Dec 09 14:51:03.302651 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-9eaa544d-e157-4794-aef7-17341fc7d749 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:03.304211 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-9eaa544d-e157-4794-aef7-17341fc7d749 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 812 time: 0.1056354 Dec 09 14:51:03.380424 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-86977450-66c7-46d5-b62d-06ef271c5445 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.44 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0 HTTP/1.1" status: 200 len: 380 time: 0.0552361 Dec 09 14:51:03.393270 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-1de493ec-c127-4d52-a987-6c29c1489fd3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Request body: {'port': {'device_id': 'ec160107-b83b-4e44-b89d-561f6bd96f92', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'admin_state_up': True, 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'security_groups': ['97e4de8e-53ca-4a2a-af5b-2f037e0d4f04']}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:51:03.507326 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-1de493ec-c127-4d52-a987-6c29c1489fd3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Made reservation on behalf of 9e02a1db560b45ddbee50b9e57d1f4f0 for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:51:03.511111 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-1de493ec-c127-4d52-a987-6c29c1489fd3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:03.636769 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-1de493ec-c127-4d52-a987-6c29c1489fd3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Allocated IP 172.20.0.12 (245ba82b-ada3-409a-912d-4462e3cd3ab8/548e3893-a447-4905-aa48-fd4e75373585/c43b7fa3-d1b6-42bc-9573-74e26a1c6cea) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:51:03.816824 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-1de493ec-c127-4d52-a987-6c29c1489fd3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:03.840723 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d399c5a-976c-43ae-9148-f723a56e53e6 req-6cb03991-21a4-483e-963c-4f0922ab9bf7 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:03.842428 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4d399c5a-976c-43ae-9148-f723a56e53e6 req-6cb03991-21a4-483e-963c-4f0922ab9bf7 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 946 time: 0.0785711 Dec 09 14:51:03.886569 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-1de493ec-c127-4d52-a987-6c29c1489fd3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:03.937921 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4d399c5a-976c-43ae-9148-f723a56e53e6 req-a62cdedd-936e-4e0a-b86b-471aba502e46 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/security-groups?id=0cc391e1-043d-4733-b34d-bcb07029588d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0844774 Dec 09 14:51:03.945294 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-1de493ec-c127-4d52-a987-6c29c1489fd3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Network 245ba82b-ada3-409a-912d-4462e3cd3ab8 is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:51:03.950353 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-1de493ec-c127-4d52-a987-6c29c1489fd3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:51:03.954017 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-1de493ec-c127-4d52-a987-6c29c1489fd3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:51:03.960435 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1de493ec-c127-4d52-a987-6c29c1489fd3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'Port': ['ID=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:51:04.007876 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-1de493ec-c127-4d52-a987-6c29c1489fd3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:04.008507 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-1de493ec-c127-4d52-a987-6c29c1489fd3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:04.051641 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-1de493ec-c127-4d52-a987-6c29c1489fd3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6620088 Dec 09 14:51:04.067624 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2632cc1d-58ba-4330-8daf-6d6951b9a8dd req-7d38aca7-4ade-4440-8015-b9400c7f75dc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:04.069178 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2632cc1d-58ba-4330-8daf-6d6951b9a8dd req-7d38aca7-4ade-4440-8015-b9400c7f75dc tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.44 "GET /v2.0/ports?device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 946 time: 0.0676618 Dec 09 14:51:04.074054 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Request body: {'port': {'device_id': 'ec160107-b83b-4e44-b89d-561f6bd96f92', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:51:04.153260 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-534de456-6a71-41c0-9acb-05510d05154c None None] Provisioning complete for port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:51:04.153874 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-534de456-6a71-41c0-9acb-05510d05154c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:04.178783 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:04.191721 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-534de456-6a71-41c0-9acb-05510d05154c None None] Port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:51:04.242621 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-2632cc1d-58ba-4330-8daf-6d6951b9a8dd req-1617822f-b23f-48cb-aa44-fac8add8d428 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Deleting port 7c005908-a50e-4407-8228-1cab79ee9190 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:51:04.242867 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-2632cc1d-58ba-4330-8daf-6d6951b9a8dd req-1617822f-b23f-48cb-aa44-fac8add8d428 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:04.260577 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3af23d3a-e880-4e83-94bf-1da1356ca956 req-17ae26df-1e1e-4a6a-81d8-7a8421e44c62 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:04.262208 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3af23d3a-e880-4e83-94bf-1da1356ca956 req-17ae26df-1e1e-4a6a-81d8-7a8421e44c62 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 932 time: 0.0494161 Dec 09 14:51:04.318231 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3af23d3a-e880-4e83-94bf-1da1356ca956 req-852b08a3-bded-4938-bfea-fa985f06358e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495222 Dec 09 14:51:04.688671 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-2632cc1d-58ba-4330-8daf-6d6951b9a8dd req-1617822f-b23f-48cb-aa44-fac8add8d428 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] For port 7c005908-a50e-4407-8228-1cab79ee9190, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=7c005908-a50e-4407-8228-1cab79ee9190,segment=NetworkSegment(409d9627-ce84-4983-8ee7-6dc43e2a5de7),segment_id=409d9627-ce84-4983-8ee7-6dc43e2a5de7)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:51:04.689346 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-2632cc1d-58ba-4330-8daf-6d6951b9a8dd req-1617822f-b23f-48cb-aa44-fac8add8d428 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:04.710281 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-2632cc1d-58ba-4330-8daf-6d6951b9a8dd req-1617822f-b23f-48cb-aa44-fac8add8d428 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Calling delete_port for 7c005908-a50e-4407-8228-1cab79ee9190 owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:51:04.841864 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id c43b7fa3-d1b6-42bc-9573-74e26a1c6cea {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:51:04.849688 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:04.912103 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Transition to ACTIVE for port object c43b7fa3-d1b6-42bc-9573-74e26a1c6cea will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:51:04.913101 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-2632cc1d-58ba-4330-8daf-6d6951b9a8dd req-1617822f-b23f-48cb-aa44-fac8add8d428 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:04.921772 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:04.924747 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['7c005908-a50e-4407-8228-1cab79ee9190'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:51:04.946601 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1617822f-b23f-48cb-aa44-fac8add8d428 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Pushing event deleted for resources: {'Port': ['ID=7c005908-a50e-4407-8228-1cab79ee9190,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:51:05.030423 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-2632cc1d-58ba-4330-8daf-6d6951b9a8dd req-1617822f-b23f-48cb-aa44-fac8add8d428 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] No DVR routers for this DVR port 7c005908-a50e-4407-8228-1cab79ee9190 on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:51:05.037436 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-2632cc1d-58ba-4330-8daf-6d6951b9a8dd req-1617822f-b23f-48cb-aa44-fac8add8d428 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:05.040728 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2632cc1d-58ba-4330-8daf-6d6951b9a8dd req-1617822f-b23f-48cb-aa44-fac8add8d428 tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.44 "DELETE /v2.0/ports/7c005908-a50e-4407-8228-1cab79ee9190 HTTP/1.1" status: 204 len: 173 time: 0.9638124 Dec 09 14:51:05.041807 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0c2a72ba-e05e-4dc9-9ed2-aa763085888d', 'name': 'network-vif-deleted', 'tag': '7c005908-a50e-4407-8228-1cab79ee9190'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:51:05.044114 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1c0e6116-aab7-408f-995c-e8aa997ccfb0" -d '{"events": [{"server_uuid": "0c2a72ba-e05e-4dc9-9ed2-aa763085888d", "name": "network-vif-deleted", "tag": "7c005908-a50e-4407-8228-1cab79ee9190"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:51:05.083577 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Pushing event updated for resources: {'Port': ['ID=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:51:05.090944 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fae790e8-c27d-4ffa-9332-c6c9abb62074 req-a2a64fd7-d556-40ea-9bcd-29c3bd23784b tempest-VolumesActionsTest-63436509 tempest-VolumesActionsTest-63436509-project] 10.222.0.39 "GET /v2.0/ports?device_id=0c2a72ba-e05e-4dc9-9ed2-aa763085888d HTTP/1.1" status: 200 len: 210 time: 0.0618916 Dec 09 14:51:05.112186 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:51:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-52fc6e83-8377-43d8-8302-fdacaaad0b48 x-openstack-request-id: req-52fc6e83-8377-43d8-8302-fdacaaad0b48 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:51:05.112747 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0c2a72ba-e05e-4dc9-9ed2-aa763085888d", "name": "network-vif-deleted", "tag": "7c005908-a50e-4407-8228-1cab79ee9190", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:51:05.112747 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-52fc6e83-8377-43d8-8302-fdacaaad0b48 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:51:05.113118 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0c2a72ba-e05e-4dc9-9ed2-aa763085888d', 'name': 'network-vif-deleted', 'tag': '7c005908-a50e-4407-8228-1cab79ee9190', 'status': 'completed', 'code': 200} Dec 09 14:51:05.151758 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Attempting to bind port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:51:05.152202 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Attempting to bind port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:51:05.152598 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Attempting to bind port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea on network 245ba82b-ada3-409a-912d-4462e3cd3ab8 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:51:05.157285 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea on network 245ba82b-ada3-409a-912d-4462e3cd3ab8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:51:05.157618 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Attempting to bind port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea on network 245ba82b-ada3-409a-912d-4462e3cd3ab8 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:51:05.162970 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 50, 45), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:51:05.163327 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Checking segment: {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:51:05.163758 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Bound using segment: {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:51:05.164319 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Bound port: c43b7fa3-d1b6-42bc-9573-74e26a1c6cea, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:51:05.164570 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:05.244731 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] For port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:51:05.248127 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] For port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:51:05.253698 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:05.286214 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:05.286885 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:05.288338 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] 10.222.0.44 "PUT /v2.0/ports/c43b7fa3-d1b6-42bc-9573-74e26a1c6cea HTTP/1.1" status: 200 len: 1094 time: 1.2181826 Dec 09 14:51:05.312209 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f40a060a-68c1-495b-b49f-1e8b9f4bffc8 service neutron] Pushing event updated for resources: {'Port': ['ID=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:51:05.372058 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-48b88bf4-2349-4c6f-bbb1-62408a217dea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:05.373720 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-48b88bf4-2349-4c6f-bbb1-62408a217dea service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 1097 time: 0.0436196 Dec 09 14:51:05.421265 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-94a7f83a-e2e0-459f-b43f-1a138da3fedb service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea HTTP/1.1" status: 200 len: 217 time: 0.0387170 Dec 09 14:51:05.444679 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f97fa32-772f-441f-9850-24367cb37d78 req-c48aa1a5-4d82-473f-a26a-1fcaa8a6326d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:05.446888 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2f97fa32-772f-441f-9850-24367cb37d78 req-c48aa1a5-4d82-473f-a26a-1fcaa8a6326d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 944 time: 0.0539401 Dec 09 14:51:05.481900 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-adbb8e60-f7d2-4381-8a7a-37b0c9694d1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:05.483391 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-adbb8e60-f7d2-4381-8a7a-37b0c9694d1a service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0534084 Dec 09 14:51:05.501325 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2f97fa32-772f-441f-9850-24367cb37d78 req-7ad9a03e-6ab8-4969-b3a0-9aa8a5cc17d6 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476189 Dec 09 14:51:05.536811 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-e8e53ca9-cc57-43f6-b31c-48442d4ba638 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:05.538101 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-e8e53ca9-cc57-43f6-b31c-48442d4ba638 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0424573 Dec 09 14:51:05.634351 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-012408d9-baa9-41db-8cd4-bbd2a2610efd service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0885286 Dec 09 14:51:05.730066 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93d60ccf-fb18-483c-bd7f-e2cb6d1cd536 req-a07eb0e3-8943-445d-b092-41ca5b3cb248 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0889320 Dec 09 14:51:06.616881 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d7171d3-a4fe-46bf-b87e-60469b352b72 req-87f8976a-9a84-45c9-97d8-f8d59806941b tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:06.618450 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3d7171d3-a4fe-46bf-b87e-60469b352b72 req-87f8976a-9a84-45c9-97d8-f8d59806941b tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 944 time: 0.0490887 Dec 09 14:51:06.669663 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3d7171d3-a4fe-46bf-b87e-60469b352b72 req-ba71df62-5cfc-4799-9f94-14b1dedf4a63 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445673 Dec 09 14:51:07.115162 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ec160107-b83b-4e44-b89d-561f6bd96f92', 'tag': 'c43b7fa3-d1b6-42bc-9573-74e26a1c6cea'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:51:07.119059 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-62d4c53c-19f6-41a6-a6a6-3d5d8b4ef57c" -d '{"events": [{"name": "network-changed", "server_uuid": "ec160107-b83b-4e44-b89d-561f6bd96f92", "tag": "c43b7fa3-d1b6-42bc-9573-74e26a1c6cea"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:51:07.160050 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:51:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c6812f1f-df48-4403-bf7b-604dd141122b x-openstack-request-id: req-c6812f1f-df48-4403-bf7b-604dd141122b {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:51:07.160345 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ec160107-b83b-4e44-b89d-561f6bd96f92", "tag": "c43b7fa3-d1b6-42bc-9573-74e26a1c6cea", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:51:07.160603 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-c6812f1f-df48-4403-bf7b-604dd141122b {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:51:07.161012 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ec160107-b83b-4e44-b89d-561f6bd96f92', 'tag': 'c43b7fa3-d1b6-42bc-9573-74e26a1c6cea', 'status': 'completed', 'code': 200} Dec 09 14:51:07.798112 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e692feb4-e1d8-4a34-a4e6-af2b5e532924 req-6b6e954c-4338-46c5-86e1-2a2d8361c416 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:07.799565 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e692feb4-e1d8-4a34-a4e6-af2b5e532924 req-6b6e954c-4338-46c5-86e1-2a2d8361c416 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 944 time: 0.0534658 Dec 09 14:51:07.848720 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e692feb4-e1d8-4a34-a4e6-af2b5e532924 req-3da64baa-8170-4a64-8c01-0ddd7545f9fa tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428329 Dec 09 14:51:08.104411 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 7c005908-a50e-4407-8228-1cab79ee9190 no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:51:08.135150 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: 7c005908-a50e-4407-8228-1cab79ee9190 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:51:08.135494 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 7c005908-a50e-4407-8228-1cab79ee9190 not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:51:08.974716 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d505a513-c014-4b7c-9274-168cc8ba2e2b req-59373a16-6106-4b18-9cca-b57e2ebf7915 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:08.976107 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d505a513-c014-4b7c-9274-168cc8ba2e2b req-59373a16-6106-4b18-9cca-b57e2ebf7915 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 944 time: 0.0487876 Dec 09 14:51:09.033296 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-d505a513-c014-4b7c-9274-168cc8ba2e2b req-7e8d6797-6c5a-49fb-902f-ba17a6a0eeef tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484650 Dec 09 14:51:10.138782 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d4c53c-19f6-41a6-a6a6-3d5d8b4ef57c req-3a1245f2-b7b7-435e-8b6f-70b32a6a2640 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:10.140299 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-62d4c53c-19f6-41a6-a6a6-3d5d8b4ef57c req-3a1245f2-b7b7-435e-8b6f-70b32a6a2640 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 1097 time: 0.0412507 Dec 09 14:51:10.160858 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a5a9286-91b6-4d79-8fb0-f50baa8f1454 req-3f1c1c84-bdc8-4d20-a3c4-9f5fbad373e9 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:10.162382 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2a5a9286-91b6-4d79-8fb0-f50baa8f1454 req-3f1c1c84-bdc8-4d20-a3c4-9f5fbad373e9 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 944 time: 0.0495257 Dec 09 14:51:10.210068 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-2a5a9286-91b6-4d79-8fb0-f50baa8f1454 req-e7885f78-54f1-47cf-9742-1b7249d7079d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416512 Dec 09 14:51:10.231423 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d4c53c-19f6-41a6-a6a6-3d5d8b4ef57c req-0a9451ff-7448-4c17-9ee3-a05f292b3bfe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:10.232955 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-62d4c53c-19f6-41a6-a6a6-3d5d8b4ef57c req-0a9451ff-7448-4c17-9ee3-a05f292b3bfe service neutron] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 913 time: 0.0850554 Dec 09 14:51:10.280294 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-62d4c53c-19f6-41a6-a6a6-3d5d8b4ef57c req-3d381791-aaa6-44ba-91e9-ca64bcc55520 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea HTTP/1.1" status: 200 len: 217 time: 0.0382369 Dec 09 14:51:10.334962 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d4c53c-19f6-41a6-a6a6-3d5d8b4ef57c req-f8063758-f80b-46d6-8635-8cc4e72587c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:10.337189 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-62d4c53c-19f6-41a6-a6a6-3d5d8b4ef57c req-f8063758-f80b-46d6-8635-8cc4e72587c1 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0482607 Dec 09 14:51:10.388728 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62d4c53c-19f6-41a6-a6a6-3d5d8b4ef57c req-37901415-6d93-4663-b35b-73660c29bcd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:10.390221 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-62d4c53c-19f6-41a6-a6a6-3d5d8b4ef57c req-37901415-6d93-4663-b35b-73660c29bcd3 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0450044 Dec 09 14:51:10.484214 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-62d4c53c-19f6-41a6-a6a6-3d5d8b4ef57c req-c72c75c5-5023-4985-b9f6-eae22f632ac6 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0851319 Dec 09 14:51:10.582139 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-62d4c53c-19f6-41a6-a6a6-3d5d8b4ef57c req-c839db87-e966-48d2-940e-190aa59e417d service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901811 Dec 09 14:51:11.336694 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fb82914-a684-42bc-8524-487dcbdaa426 req-01cfec50-2a71-4dd8-901e-ed249fb6d1f6 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:11.338142 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2fb82914-a684-42bc-8524-487dcbdaa426 req-01cfec50-2a71-4dd8-901e-ed249fb6d1f6 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 944 time: 0.0496223 Dec 09 14:51:11.391019 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-2fb82914-a684-42bc-8524-487dcbdaa426 req-baeaf8d8-4aa1-4cdb-b28d-c0b9d5180e52 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469253 Dec 09 14:51:12.542899 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3305323-e689-4dd1-ad41-e32181a1359e req-ed0d30b7-ca7d-42c4-aecb-e98c8147e3b1 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:12.544712 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f3305323-e689-4dd1-ad41-e32181a1359e req-ed0d30b7-ca7d-42c4-aecb-e98c8147e3b1 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 944 time: 0.0671885 Dec 09 14:51:12.609696 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f3305323-e689-4dd1-ad41-e32181a1359e req-376a8782-9d2f-4df5-8e78-37c2cf7663ea tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0551927 Dec 09 14:51:13.741769 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device c43b7fa3-d1b6-42bc-9573-74e26a1c6cea details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:51:13.745848 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62a352eb-5b05-4305-8548-2c2a1a8fbd0e req-3ea0c0c3-74d1-4eb4-bfb3-8d48be293e07 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:13.747482 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-62a352eb-5b05-4305-8548-2c2a1a8fbd0e req-3ea0c0c3-74d1-4eb4-bfb3-8d48be293e07 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 944 time: 0.0613315 Dec 09 14:51:13.801775 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-62a352eb-5b05-4305-8548-2c2a1a8fbd0e req-fc5e768f-0eea-4db8-810a-13fca6827885 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478013 Dec 09 14:51:13.872341 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:51:13.886060 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': 'c43b7fa3-d1b6-42bc-9573-74e26a1c6cea', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'port_id': 'c43b7fa3-d1b6-42bc-9573-74e26a1c6cea', 'mac_address': 'fa:16:3e:71:a7:a7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 400, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:51:13.929709 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:13.943903 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id c43b7fa3-d1b6-42bc-9573-74e26a1c6cea {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:51:13.964330 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:51:13.972606 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:14.024135 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:51:14.193715 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['c43b7fa3-d1b6-42bc-9573-74e26a1c6cea'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:51:14.857617 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:14.934150 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a1f10d6-e77e-4be3-883d-1f0eb59bbed8 req-68f10b57-e737-4a9c-beca-71dc1d3b7cbe tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:14.936425 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7a1f10d6-e77e-4be3-883d-1f0eb59bbed8 req-68f10b57-e737-4a9c-beca-71dc1d3b7cbe tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 945 time: 0.0533910 Dec 09 14:51:14.988931 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-7a1f10d6-e77e-4be3-883d-1f0eb59bbed8 req-06737712-9de3-4a35-aa87-81b31baa16c7 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461185 Dec 09 14:51:15.768626 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device c43b7fa3-d1b6-42bc-9573-74e26a1c6cea up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:51:15.836304 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:51:15.840695 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:51:15.841055 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:15.926696 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:15.952930 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ec160107-b83b-4e44-b89d-561f6bd96f92', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c43b7fa3-d1b6-42bc-9573-74e26a1c6cea'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:51:15.955277 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02259204-86ed-4dc9-b620-ceccc6e49d83" -d '{"events": [{"server_uuid": "ec160107-b83b-4e44-b89d-561f6bd96f92", "name": "network-vif-plugged", "status": "completed", "tag": "c43b7fa3-d1b6-42bc-9573-74e26a1c6cea"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:51:15.972233 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:51:15.981920 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:16.010189 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:51:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-78cb733a-2765-4b95-aad5-1bb7b3b5c4f6 x-openstack-request-id: req-78cb733a-2765-4b95-aad5-1bb7b3b5c4f6 {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:51:16.010520 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ec160107-b83b-4e44-b89d-561f6bd96f92", "name": "network-vif-plugged", "status": "completed", "tag": "c43b7fa3-d1b6-42bc-9573-74e26a1c6cea", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:51:16.010757 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-78cb733a-2765-4b95-aad5-1bb7b3b5c4f6 {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:51:16.011162 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ec160107-b83b-4e44-b89d-561f6bd96f92', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'c43b7fa3-d1b6-42bc-9573-74e26a1c6cea', 'code': 200} Dec 09 14:51:16.044609 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:51:16.158027 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3a7509f-4b87-409c-8ec9-2332412378f3 req-5429a395-9cc7-493a-94e0-c204fc8411b4 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:16.168976 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c3a7509f-4b87-409c-8ec9-2332412378f3 req-5429a395-9cc7-493a-94e0-c204fc8411b4 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 946 time: 0.0742106 Dec 09 14:51:16.231475 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c3a7509f-4b87-409c-8ec9-2332412378f3 req-d835acf7-363d-4bc5-ab08-0ee2f0d365c1 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0614285 Dec 09 14:51:16.286623 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1b3eec2-941e-4460-8114-b9ef4b794dc5 req-ca98e34d-7fbc-48e9-8854-be372d347fbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:16.288466 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a1b3eec2-941e-4460-8114-b9ef4b794dc5 req-ca98e34d-7fbc-48e9-8854-be372d347fbe service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 1099 time: 0.0602038 Dec 09 14:51:16.343053 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a1b3eec2-941e-4460-8114-b9ef4b794dc5 req-b5465e96-34f3-40d8-ad17-b9c617a716c1 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456076 Dec 09 14:51:17.385314 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3cfa8f7-4271-4545-99ec-890cc0b58b6f req-c34a919c-7552-479c-aad8-66d0615e948d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:17.387725 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e3cfa8f7-4271-4545-99ec-890cc0b58b6f req-c34a919c-7552-479c-aad8-66d0615e948d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 946 time: 0.0678043 Dec 09 14:51:17.449515 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e3cfa8f7-4271-4545-99ec-890cc0b58b6f req-878d21ea-9e82-4876-99bf-c55579c7abd5 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0555801 Dec 09 14:51:18.579398 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc4959e3-ae9e-431d-84a7-32a9008dee80 req-affb0f61-eac6-46cc-a4de-cce50455d1c5 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:18.580935 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-cc4959e3-ae9e-431d-84a7-32a9008dee80 req-affb0f61-eac6-46cc-a4de-cce50455d1c5 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 946 time: 0.0542743 Dec 09 14:51:18.656136 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-cc4959e3-ae9e-431d-84a7-32a9008dee80 req-8e4a0871-3cb6-4ba7-91cf-07a01adb40c1 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0666935 Dec 09 14:51:18.801481 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b5043f9-71ba-42dc-8aae-a7d9cf65b13e req-215d20d7-7877-47cc-921b-6fe4821ccbfe tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:18.803062 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0b5043f9-71ba-42dc-8aae-a7d9cf65b13e req-215d20d7-7877-47cc-921b-6fe4821ccbfe tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 946 time: 0.0511253 Dec 09 14:51:18.860400 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-0b5043f9-71ba-42dc-8aae-a7d9cf65b13e req-63324543-aece-4224-9e15-59075ac5e5c8 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0499218 Dec 09 14:51:18.891819 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 34034) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:51:18.992138 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-82b11b6b-55ca-4d1c-b5c4-122b5043f4a7 tempest-TestVolumeBootPattern-769977608 tempest-TestVolumeBootPattern-769977608-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:18.997538 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34038) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:51:18.997792 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-82b11b6b-55ca-4d1c-b5c4-122b5043f4a7 tempest-TestVolumeBootPattern-769977608 tempest-TestVolumeBootPattern-769977608-project-admin] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 1094 time: 0.1040077 Dec 09 14:51:19.002318 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Request body: {'floatingip': {'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'port_id': 'c43b7fa3-d1b6-42bc-9573-74e26a1c6cea', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address': '172.20.0.12'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:51:19.029688 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for floatingip, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:19.417726 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:19.539925 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Allocated IP 172.27.0.154 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/1ec1fe55-e757-4bd0-accd-687d5d785bef) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:51:19.660169 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:19.703599 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:19.748204 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:51:19.753861 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:51:19.757892 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:51:19.784758 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'Port': ['ID=1ec1fe55-e757-4bd0-accd-687d5d785bef,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:51:19.798119 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:19.798119 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:19.798580 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:19.798580 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:19.799019 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:19.799208 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:19.799533 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:19.799960 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:19.800291 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:19.800617 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:19.800944 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:19.801261 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:19.801576 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:20.155505 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:20.237382 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:20.417230 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:20.423024 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-130461426'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:20.497999 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'Port': ['ID=1ec1fe55-e757-4bd0-accd-687d5d785bef,revision_number=2']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:51:20.511681 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:20.620350 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.l3_db [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Floating IP 2ea75a48-5744-4a2d-af6a-18dad1ebd4e3 associated. External IP: 172.27.0.154, port: c43b7fa3-d1b6-42bc-9573-74e26a1c6cea. Dec 09 14:51:20.864089 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Router 0afa8c36-934f-4ee2-8457-fb4e00214c4d has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:51:20.979014 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:51:20.990341 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1fca73a-7d89-4568-80da-0d5a85e06f95 None None] Sync routers for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:51:21.002035 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:21.005574 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1fca73a-7d89-4568-80da-0d5a85e06f95 None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:51:21.006510 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-c1fca73a-7d89-4568-80da-0d5a85e06f95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:50:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:51:21.032569 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-360df34b-e329-4389-b97e-2cee16a1cb12 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.0337234 Dec 09 14:51:21.033183 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ec160107-b83b-4e44-b89d-561f6bd96f92', 'tag': 'c43b7fa3-d1b6-42bc-9573-74e26a1c6cea'}] {{(pid=109062) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:51:21.035557 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3f1ec408b0eec5a36b56e0a757eff0f4875d9a95eff62f4d0b4a62bb27a3b600" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-95a0a1e8-50b9-4f60-be35-873489032410" -d '{"events": [{"name": "network-changed", "server_uuid": "ec160107-b83b-4e44-b89d-561f6bd96f92", "tag": "c43b7fa3-d1b6-42bc-9573-74e26a1c6cea"}]}' {{(pid=109062) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:51:21.077374 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:51:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4a88a64f-2a94-4763-a53f-8311028dd3c3 x-openstack-request-id: req-4a88a64f-2a94-4763-a53f-8311028dd3c3 {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:51:21.077682 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ec160107-b83b-4e44-b89d-561f6bd96f92", "tag": "c43b7fa3-d1b6-42bc-9573-74e26a1c6cea", "status": "completed", "code": 200}]} {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:51:21.077943 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-4a88a64f-2a94-4763-a53f-8311028dd3c3 {{(pid=109062) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:51:21.078354 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ec160107-b83b-4e44-b89d-561f6bd96f92', 'tag': 'c43b7fa3-d1b6-42bc-9573-74e26a1c6cea', 'status': 'completed', 'code': 200} Dec 09 14:51:21.133699 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-c1fca73a-7d89-4568-80da-0d5a85e06f95 None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:51:21.156053 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a0a1e8-50b9-4f60-be35-873489032410 req-714f2cc7-79ac-4fb5-9cd6-9950c6ec4ad3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:21.157767 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-95a0a1e8-50b9-4f60-be35-873489032410 req-714f2cc7-79ac-4fb5-9cd6-9950c6ec4ad3 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 1099 time: 0.0533600 Dec 09 14:51:21.275270 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a0a1e8-50b9-4f60-be35-873489032410 req-cb249f73-f642-47a7-9bac-919e6417488c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:21.276845 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-95a0a1e8-50b9-4f60-be35-873489032410 req-cb249f73-f642-47a7-9bac-919e6417488c service neutron] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 913 time: 0.1103420 Dec 09 14:51:21.361862 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-95a0a1e8-50b9-4f60-be35-873489032410 req-17f0afd4-9988-4c94-9b54-d7d6880ec000 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea HTTP/1.1" status: 200 len: 1000 time: 0.0756843 Dec 09 14:51:21.423423 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a0a1e8-50b9-4f60-be35-873489032410 req-a8d2493d-6ea5-4937-a09a-3fc0d969b8fa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:21.425322 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-95a0a1e8-50b9-4f60-be35-873489032410 req-a8d2493d-6ea5-4937-a09a-3fc0d969b8fa service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0538938 Dec 09 14:51:21.432311 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-c1fca73a-7d89-4568-80da-0d5a85e06f95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '2ea75a48-5744-4a2d-af6a-18dad1ebd4e3', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'floating_ip_address': '172.27.0.154', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'port_id': 'c43b7fa3-d1b6-42bc-9573-74e26a1c6cea', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 691, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'mac_address': 'fa:16:3e:71:a7:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec160107-b83b-4e44-b89d-561f6bd96f92', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:51:20Z', 'updated_at': '2021-12-09T14:51:20Z', 'revision_number': 0, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:51:21.469695 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1fca73a-7d89-4568-80da-0d5a85e06f95 None None] Checking router: 0afa8c36-934f-4ee2-8457-fb4e00214c4d for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:51:21.480654 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1fca73a-7d89-4568-80da-0d5a85e06f95 None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:51:21.481673 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-c1fca73a-7d89-4568-80da-0d5a85e06f95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:50:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:51:21.482703 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95a0a1e8-50b9-4f60-be35-873489032410 req-305f4843-714b-4f1b-9db6-82c069b2e292 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:21.484334 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-95a0a1e8-50b9-4f60-be35-873489032410 req-305f4843-714b-4f1b-9db6-82c069b2e292 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0498502 Dec 09 14:51:21.597130 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-95a0a1e8-50b9-4f60-be35-873489032410 req-852c1b0b-f94a-4e82-b347-70172aeab910 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1048558 Dec 09 14:51:21.618944 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-c1fca73a-7d89-4568-80da-0d5a85e06f95 None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:51:21.732351 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-95a0a1e8-50b9-4f60-be35-873489032410 req-90262f48-48d3-4f8e-a5b4-5c7b548125dd service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1245792 Dec 09 14:51:21.887690 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-c1fca73a-7d89-4568-80da-0d5a85e06f95 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '2ea75a48-5744-4a2d-af6a-18dad1ebd4e3', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'floating_ip_address': '172.27.0.154', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'port_id': 'c43b7fa3-d1b6-42bc-9573-74e26a1c6cea', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 691, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'mac_address': 'fa:16:3e:71:a7:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec160107-b83b-4e44-b89d-561f6bd96f92', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:51:20Z', 'updated_at': '2021-12-09T14:51:20Z', 'revision_number': 0, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:51:21.919276 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1fca73a-7d89-4568-80da-0d5a85e06f95 None None] The sync data for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi is: [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '2ea75a48-5744-4a2d-af6a-18dad1ebd4e3', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'floating_ip_address': '172.27.0.154', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'port_id': 'c43b7fa3-d1b6-42bc-9573-74e26a1c6cea', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 691, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'mac_address': 'fa:16:3e:71:a7:a7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ec160107-b83b-4e44-b89d-561f6bd96f92', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:51:20Z', 'updated_at': '2021-12-09T14:51:20Z', 'revision_number': 0, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:51:22.155523 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa3b8dd1-4bea-4555-b0b8-9d2825a895bd None None] New status for floating IP 2ea75a48-5744-4a2d-af6a-18dad1ebd4e3: ACTIVE {{(pid=109064) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:51:27.025453 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-d2fd5f44-5895-463c-a038-8b809f740b83 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:27.446990 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:51:27.991076 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34158) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:51:28.039269 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_v2 [None req-cdba696c-050d-48fd-8add-e989a78fe2fa admin admin] Deleting subnet b057d961-cd95-47ff-9c01-42519e40216d {{(pid=109062) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:51:28.042739 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cdba696c-050d-48fd-8add-e989a78fe2fa admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.080847 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cdba696c-050d-48fd-8add-e989a78fe2fa admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-130415749'] for subnet, precommit_delete_associations {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.121121 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cdba696c-050d-48fd-8add-e989a78fe2fa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.178834 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cdba696c-050d-48fd-8add-e989a78fe2fa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-130461228', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-130768914'] for subnet, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.202648 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdba696c-050d-48fd-8add-e989a78fe2fa admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b057d961-cd95-47ff-9c01-42519e40216d,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:51:28.206594 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-cdba696c-050d-48fd-8add-e989a78fe2fa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.209629 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-cdba696c-050d-48fd-8add-e989a78fe2fa admin admin] 10.222.0.39 "DELETE /v2.0/subnets/b057d961-cd95-47ff-9c01-42519e40216d HTTP/1.1" status: 204 len: 168 time: 0.2172008 Dec 09 14:51:28.212692 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 34160) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:51:28.288840 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.366672 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.387856 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['82bc4169-86f1-48dd-b3a9-b16bd54b9d6f']}} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:51:28.397012 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '409d9627-ce84-4983-8ee7-6dc43e2a5de7') {'for_net_delete': True} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:51:28.397312 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.services.segments.db [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '409d9627-ce84-4983-8ee7-6dc43e2a5de7') {} {{(pid=109061) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:51:28.406643 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-1271949'] for segment, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.421410 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.427865 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Releasing vlan 434 on physical network physnet1 to pool {{(pid=109061) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:51:28.428273 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-133412129'] for segment, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: Traceback (most recent call last): Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: timer() Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: cb(*args, **kw) Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: return func(*args, **kwargs) Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: self._notify() Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: self.callback(batched_events) Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: event.method(event) Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: return f(self, *a, **k) Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._get(url).json() Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: return self.request(url, 'GET', **kwargs) Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:51:28.429894 dv-cinder-819692-8-iscsi neutron-server[109061]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:51:28.490460 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.496183 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.499362 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] 10.222.0.39 "DELETE /v2.0/networks/82bc4169-86f1-48dd-b3a9-b16bd54b9d6f HTTP/1.1" status: 204 len: 168 time: 0.2856746 Dec 09 14:51:28.510373 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Pushing event deleted for resources: {'Network': ['ID=82bc4169-86f1-48dd-b3a9-b16bd54b9d6f,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:51:28.517553 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:28.517908 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:28.518262 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:28.518601 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:28.518936 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:28.519270 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:28.519618 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:28.519960 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:28.520292 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:28.520624 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:28.520952 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:28.521279 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:28.521603 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27cdf6fb-fe98-4e63-82b1-af61b09773e1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:51:28.665578 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 34164) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:51:28.706812 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-bc02ed48-f6d3-4d3e-9893-a29e2fbaa18e admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=e851ff8bfba1434b916e3a2ae6ef065b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0400128 Dec 09 14:51:28.709478 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 34166) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:51:28.760282 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4ab9a91b-c313-46fb-a50b-7a54bf519d9b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.781062 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4ab9a91b-c313-46fb-a50b-7a54bf519d9b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.834379 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4ab9a91b-c313-46fb-a50b-7a54bf519d9b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.838265 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4ab9a91b-c313-46fb-a50b-7a54bf519d9b admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:28.840160 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-4ab9a91b-c313-46fb-a50b-7a54bf519d9b admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/0cc391e1-043d-4733-b34d-bcb07029588d HTTP/1.1" status: 204 len: 168 time: 0.1294062 Dec 09 14:51:28.850878 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ab9a91b-c313-46fb-a50b-7a54bf519d9b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0cc391e1-043d-4733-b34d-bcb07029588d,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:51:29.178192 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-733ba11e-4ffd-4be7-917c-8573d55785c7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:30.458293 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:31.823431 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:32.612252 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:44.876304 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:48.107133 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-06ba7aa1-fa32-41a0-b352-95c89cd31b28 req-229c3a20-33dc-4aff-9df8-1d44c1fc1573 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0425589 Dec 09 14:51:48.195633 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ba7aa1-fa32-41a0-b352-95c89cd31b28 req-35dfa9da-1d1b-4b64-849b-a40ef9e58742 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:48.197163 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-06ba7aa1-fa32-41a0-b352-95c89cd31b28 req-35dfa9da-1d1b-4b64-849b-a40ef9e58742 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 1099 time: 0.0426524 Dec 09 14:51:48.313924 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ba7aa1-fa32-41a0-b352-95c89cd31b28 req-f20171f2-2f71-4457-8d2e-605d580e285c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:48.315452 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-06ba7aa1-fa32-41a0-b352-95c89cd31b28 req-f20171f2-2f71-4457-8d2e-605d580e285c service neutron] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 913 time: 0.0975955 Dec 09 14:51:48.383448 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-06ba7aa1-fa32-41a0-b352-95c89cd31b28 req-c7737167-81ec-4a3e-878e-df656c710480 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea HTTP/1.1" status: 200 len: 1002 time: 0.0592620 Dec 09 14:51:48.433892 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ba7aa1-fa32-41a0-b352-95c89cd31b28 req-5af9197f-03cf-499f-8740-7defea93bf42 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:48.435400 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-06ba7aa1-fa32-41a0-b352-95c89cd31b28 req-5af9197f-03cf-499f-8740-7defea93bf42 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0437579 Dec 09 14:51:48.485683 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06ba7aa1-fa32-41a0-b352-95c89cd31b28 req-02bc384f-f049-4697-a523-c31e4f5d91ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:51:48.487125 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-06ba7aa1-fa32-41a0-b352-95c89cd31b28 req-02bc384f-f049-4697-a523-c31e4f5d91ad service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0438800 Dec 09 14:51:48.582165 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-06ba7aa1-fa32-41a0-b352-95c89cd31b28 req-86832a23-e470-47a0-a7d6-9c40a8acbf5c service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0865409 Dec 09 14:51:48.679992 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-06ba7aa1-fa32-41a0-b352-95c89cd31b28 req-83f954b5-a662-4628-99b0-8a8349de5938 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0899003 Dec 09 14:51:57.024305 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-69bfd9f8-24c8-42ae-aa3a-486344f9fd04 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:51:59.194681 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-17d0e8ab-6e4c-4742-827d-145b93be7dad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:00.459716 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:01.829179 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:02.607471 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:04.451576 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:52:07.412565 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 34432) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:52:07.526272 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a5ff5b25-f24a-4f32-ab3f-9ebf0f04dc4f admin admin] Publish callbacks [] for security_group, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:07.603450 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a5ff5b25-f24a-4f32-ab3f-9ebf0f04dc4f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:07.608437 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-a5ff5b25-f24a-4f32-ab3f-9ebf0f04dc4f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:07.646629 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-a5ff5b25-f24a-4f32-ab3f-9ebf0f04dc4f admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=e6db7427052e42bf9ab23c70df4c2161&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2329555 Dec 09 14:52:07.647530 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5ff5b25-f24a-4f32-ab3f-9ebf0f04dc4f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0bc8679b-6285-44c2-b44f-ba0727b00483,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:52:07.650483 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34436) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:52:07.702110 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5e240589-9e61-4fa2-be28-d28fa31792c3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:07.727708 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5e240589-9e61-4fa2-be28-d28fa31792c3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:07.776583 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5e240589-9e61-4fa2-be28-d28fa31792c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:07.779240 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-5e240589-9e61-4fa2-be28-d28fa31792c3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:07.780473 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-5e240589-9e61-4fa2-be28-d28fa31792c3 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/0bc8679b-6285-44c2-b44f-ba0727b00483 HTTP/1.1" status: 204 len: 168 time: 0.1282170 Dec 09 14:52:07.788187 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e240589-9e61-4fa2-be28-d28fa31792c3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0bc8679b-6285-44c2-b44f-ba0727b00483,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:52:14.891763 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:27.030108 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-89e21c9f-7e15-41d1-a857-65bb86a6c4e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:29.191946 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-cbb1f172-417d-4641-937c-6d1e7cffe0e7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:30.460193 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:31.830561 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:32.612891 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:41.456291 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:52:44.901968 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:50.191356 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a08713a9-b5f4-4d43-8b9a-77ce01f12cce req-7cebe837-9201-4b8c-ac5f-22e487ff7388 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1368163 Dec 09 14:52:50.276303 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a08713a9-b5f4-4d43-8b9a-77ce01f12cce req-db1b58b2-49b2-4279-af24-b327d0c96912 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:52:50.277801 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a08713a9-b5f4-4d43-8b9a-77ce01f12cce req-db1b58b2-49b2-4279-af24-b327d0c96912 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 1099 time: 0.0414798 Dec 09 14:52:50.386074 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a08713a9-b5f4-4d43-8b9a-77ce01f12cce req-599a1fe4-7228-4979-b7eb-f5450c67c4da service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:52:50.387490 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a08713a9-b5f4-4d43-8b9a-77ce01f12cce req-599a1fe4-7228-4979-b7eb-f5450c67c4da service neutron] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 913 time: 0.0909352 Dec 09 14:52:50.454101 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a08713a9-b5f4-4d43-8b9a-77ce01f12cce req-d1a07911-ed12-4e04-b443-ae6b20c0a3b6 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea HTTP/1.1" status: 200 len: 1002 time: 0.0591879 Dec 09 14:52:50.506402 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a08713a9-b5f4-4d43-8b9a-77ce01f12cce req-35695a36-d387-46b5-a6be-6ef58d0f2fd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:52:50.507876 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a08713a9-b5f4-4d43-8b9a-77ce01f12cce req-35695a36-d387-46b5-a6be-6ef58d0f2fd9 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0472310 Dec 09 14:52:50.554874 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a08713a9-b5f4-4d43-8b9a-77ce01f12cce req-d17293e7-291e-4bb8-a01b-0a67cea0a050 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:52:50.556401 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a08713a9-b5f4-4d43-8b9a-77ce01f12cce req-d17293e7-291e-4bb8-a01b-0a67cea0a050 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0413013 Dec 09 14:52:50.567638 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [req-a08713a9-b5f4-4d43-8b9a-77ce01f12cce req-52f95f49-44f6-4799-92fa-840be3d4d6fe service neutron] http://10.222.0.39:9696/v2.0/extensions returned with HTTP 200 {{(pid=109061) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 14:52:50.568590 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a08713a9-b5f4-4d43-8b9a-77ce01f12cce req-52f95f49-44f6-4799-92fa-840be3d4d6fe service neutron] 10.222.0.44 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048299 Dec 09 14:52:50.660924 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a08713a9-b5f4-4d43-8b9a-77ce01f12cce req-4f4901dd-f8da-496e-a213-cc77b42b0cf4 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0843263 Dec 09 14:52:50.756583 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a08713a9-b5f4-4d43-8b9a-77ce01f12cce req-9011bc60-361b-4d12-870a-afa7c8e311ee service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854425 Dec 09 14:52:57.035819 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-bc803a3d-7bdd-4955-932e-7aaf0604c2fe None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:52:59.189795 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-a8ffcc34-a3f0-4633-96f1-197a9ce3e217 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:00.469483 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:01.836920 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:02.619350 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:14.908513 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:18.461398 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:53:19.264803 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f47b7cb2-b176-4ae6-bf3b-29396ba7fb85 req-c862d840-8f4d-487c-90c8-b6a43ae08115 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:19.266379 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f47b7cb2-b176-4ae6-bf3b-29396ba7fb85 req-c862d840-8f4d-487c-90c8-b6a43ae08115 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 946 time: 0.1760416 Dec 09 14:53:19.321941 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-f47b7cb2-b176-4ae6-bf3b-29396ba7fb85 req-f4745e47-5d08-490a-9d31-638a53f7a000 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0491402 Dec 09 14:53:20.513005 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-083db7ac-17a1-47c8-81f1-353ff1488c53 req-2469ec63-d38e-4798-87a4-1c32abe99ffa tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:20.514472 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-083db7ac-17a1-47c8-81f1-353ff1488c53 req-2469ec63-d38e-4798-87a4-1c32abe99ffa tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 946 time: 0.1047952 Dec 09 14:53:20.566078 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-083db7ac-17a1-47c8-81f1-353ff1488c53 req-8319400e-435d-4c1c-9501-c5b9c05b4da0 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425503 Dec 09 14:53:20.630000 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-0ea82a33-643b-486e-af56-b9d04a8006c8 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:20.631366 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-0ea82a33-643b-486e-af56-b9d04a8006c8 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.44 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 946 time: 0.0591316 Dec 09 14:53:20.729836 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Deleting port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:53:20.730182 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:20.829186 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] For port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:53:20.829554 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:20.996445 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for floatingip, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:20.996683 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:20.997005 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.db.l3_db [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Floating IP 2ea75a48-5744-4a2d-af6a-18dad1ebd4e3 disassociated. External IP: 172.27.0.154, port: c43b7fa3-d1b6-42bc-9573-74e26a1c6cea. Dec 09 14:53:20.997344 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Calling delete_port for c43b7fa3-d1b6-42bc-9573-74e26a1c6cea owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:53:21.127867 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:21.156244 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event deleted for resources: {'Port': ['ID=c43b7fa3-d1b6-42bc-9573-74e26a1c6cea,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:53:21.166938 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:21.167328 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:21.167674 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:21.168043 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:21.168376 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:21.168706 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:21.169036 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:21.169354 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:21.169680 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:21.170010 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:21.170334 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:21.170647 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:21.170970 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:21.285098 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Router 0afa8c36-934f-4ee2-8457-fb4e00214c4d has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:53:21.395039 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:53:21.408743 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-784cdbc7-3922-457f-8e0e-91996cb9143b None None] Sync routers for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:53:21.419755 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-784cdbc7-3922-457f-8e0e-91996cb9143b None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:53:21.420372 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-784cdbc7-3922-457f-8e0e-91996cb9143b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:52:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:53:21.436664 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] No DVR routers for this DVR port c43b7fa3-d1b6-42bc-9573-74e26a1c6cea on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:53:21.439337 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:21.442666 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-b437d72b-c5f9-4df2-9270-df8f0754012c req-315d0de4-0705-4c5a-8dc1-81de1ab4e346 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.44 "DELETE /v2.0/ports/c43b7fa3-d1b6-42bc-9573-74e26a1c6cea HTTP/1.1" status: 204 len: 173 time: 0.8043416 Dec 09 14:53:21.443107 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ec160107-b83b-4e44-b89d-561f6bd96f92', 'name': 'network-vif-deleted', 'tag': 'c43b7fa3-d1b6-42bc-9573-74e26a1c6cea'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:53:21.445477 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-19213f3c-0c79-4e6a-99ea-b420dc03c43f" -d '{"events": [{"server_uuid": "ec160107-b83b-4e44-b89d-561f6bd96f92", "name": "network-vif-deleted", "tag": "c43b7fa3-d1b6-42bc-9573-74e26a1c6cea"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:53:21.575311 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:53:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-68cde47f-90b4-4a59-b0c0-6d5f038143c3 x-openstack-request-id: req-68cde47f-90b4-4a59-b0c0-6d5f038143c3 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:53:21.575975 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ec160107-b83b-4e44-b89d-561f6bd96f92", "name": "network-vif-deleted", "tag": "c43b7fa3-d1b6-42bc-9573-74e26a1c6cea", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:53:21.575975 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-68cde47f-90b4-4a59-b0c0-6d5f038143c3 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:53:21.576357 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ec160107-b83b-4e44-b89d-561f6bd96f92', 'name': 'network-vif-deleted', 'tag': 'c43b7fa3-d1b6-42bc-9573-74e26a1c6cea', 'status': 'completed', 'code': 200} Dec 09 14:53:21.667711 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-4e81ebaa-859c-42db-ae38-d22f83c288d2 req-0217bb9e-0f7e-4774-84b3-9918e6fbb067 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=ec160107-b83b-4e44-b89d-561f6bd96f92 HTTP/1.1" status: 200 len: 210 time: 0.0262830 Dec 09 14:53:21.677926 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-784cdbc7-3922-457f-8e0e-91996cb9143b None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:53:21.877702 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-784cdbc7-3922-457f-8e0e-91996cb9143b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:53:21.903475 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-784cdbc7-3922-457f-8e0e-91996cb9143b None None] Checking router: 0afa8c36-934f-4ee2-8457-fb4e00214c4d for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:53:21.911747 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-784cdbc7-3922-457f-8e0e-91996cb9143b None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:53:21.912356 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-784cdbc7-3922-457f-8e0e-91996cb9143b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:52:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:53:22.020978 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-784cdbc7-3922-457f-8e0e-91996cb9143b None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:53:22.226495 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-784cdbc7-3922-457f-8e0e-91996cb9143b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:53:22.252500 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-784cdbc7-3922-457f-8e0e-91996cb9143b None None] The sync data for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi is: [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:53:22.472468 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d23a7d60-966c-4b32-a287-117d5fd809e7 None None] New status for floating IP 2ea75a48-5744-4a2d-af6a-18dad1ebd4e3: DOWN {{(pid=109064) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:53:22.952474 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-86a26dae-874d-4f38-8865-93474d6af4de tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1578162193&fields=id&tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0 HTTP/1.1" status: 200 len: 267 time: 0.0505686 Dec 09 14:53:23.061602 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e16991b8-8667-4f18-a159-04110a83cce1 req-6e866579-ad11-428d-b36d-961d5a5d2b9d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:23.063163 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-6e866579-ad11-428d-b36d-961d5a5d2b9d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 812 time: 0.1003888 Dec 09 14:53:23.078269 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-6a931535-1730-4e20-bedc-f96c8d74d6dc tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/quotas/9e02a1db560b45ddbee50b9e57d1f4f0 HTTP/1.1" status: 200 len: 375 time: 0.0092285 Dec 09 14:53:23.134304 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-f7f94f1e-be62-45b6-8b03-b5cae08fe18b tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0486739 Dec 09 14:53:23.152024 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-7ee16e11-ee8d-4ba1-96fe-234b73a789ab service neutron] http://10.222.0.39:9696/v2.0/extensions returned with HTTP 200 {{(pid=109061) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 14:53:23.152972 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-7ee16e11-ee8d-4ba1-96fe-234b73a789ab service neutron] 10.222.0.39 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049174 Dec 09 14:53:23.247285 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-a0aa506e-7025-409c-aa9d-8f33a46af8b9 service neutron] 10.222.0.39 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887756 Dec 09 14:53:23.341845 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c827b1e0-2537-4467-a17d-9e6ea18c095a service neutron] 10.222.0.39 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0854325 Dec 09 14:53:23.632568 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-07a8735b-a0e2-40bd-92b8-78f55cc1c9a2 req-d6f43283-4d06-44fd-989e-09348f30666b tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 210 time: 0.0264819 Dec 09 14:53:24.239547 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device c43b7fa3-d1b6-42bc-9573-74e26a1c6cea no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:53:24.260520 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: c43b7fa3-d1b6-42bc-9573-74e26a1c6cea {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:53:24.260871 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device c43b7fa3-d1b6-42bc-9573-74e26a1c6cea not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:53:24.656602 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e16991b8-8667-4f18-a159-04110a83cce1 req-2e849542-b6ed-42cf-ac7c-a4f3e70dd2df tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:24.658213 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-2e849542-b6ed-42cf-ac7c-a4f3e70dd2df tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 812 time: 0.1068263 Dec 09 14:53:24.736122 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e3b5e072-6407-4b06-9966-b78db1c89d5f req-7034bc21-cd03-46a2-9272-031bc3199218 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 210 time: 0.0372856 Dec 09 14:53:24.747245 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-14a17277-4586-4c36-93b9-f902e972fbdb tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.44 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0 HTTP/1.1" status: 200 len: 380 time: 0.0791795 Dec 09 14:53:24.757182 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-e16991b8-8667-4f18-a159-04110a83cce1 req-980d7e3f-4f79-44a9-a622-9754c4a00a89 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Request body: {'port': {'device_id': '81780f80-b704-4238-a626-320bce1e01af', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'admin_state_up': True, 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'security_groups': ['97e4de8e-53ca-4a2a-af5b-2f037e0d4f04']}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:53:24.866024 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e16991b8-8667-4f18-a159-04110a83cce1 req-980d7e3f-4f79-44a9-a622-9754c4a00a89 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Made reservation on behalf of 9e02a1db560b45ddbee50b9e57d1f4f0 for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:53:24.869551 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e16991b8-8667-4f18-a159-04110a83cce1 req-980d7e3f-4f79-44a9-a622-9754c4a00a89 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:24.998358 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-e16991b8-8667-4f18-a159-04110a83cce1 req-980d7e3f-4f79-44a9-a622-9754c4a00a89 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Allocated IP 172.20.0.13 (245ba82b-ada3-409a-912d-4462e3cd3ab8/548e3893-a447-4905-aa48-fd4e75373585/65be3d81-a35f-4fa9-a69a-59deb88c6a80) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:53:25.142391 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e16991b8-8667-4f18-a159-04110a83cce1 req-980d7e3f-4f79-44a9-a622-9754c4a00a89 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:25.180231 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e16991b8-8667-4f18-a159-04110a83cce1 req-980d7e3f-4f79-44a9-a622-9754c4a00a89 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:25.220003 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e16991b8-8667-4f18-a159-04110a83cce1 req-980d7e3f-4f79-44a9-a622-9754c4a00a89 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Network 245ba82b-ada3-409a-912d-4462e3cd3ab8 is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:53:25.222917 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-e16991b8-8667-4f18-a159-04110a83cce1 req-980d7e3f-4f79-44a9-a622-9754c4a00a89 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:53:25.230026 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-e16991b8-8667-4f18-a159-04110a83cce1 req-980d7e3f-4f79-44a9-a622-9754c4a00a89 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:53:25.260299 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-980d7e3f-4f79-44a9-a622-9754c4a00a89 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'Port': ['ID=65be3d81-a35f-4fa9-a69a-59deb88c6a80,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:53:25.289250 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e16991b8-8667-4f18-a159-04110a83cce1 req-980d7e3f-4f79-44a9-a622-9754c4a00a89 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:25.289872 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e16991b8-8667-4f18-a159-04110a83cce1 req-980d7e3f-4f79-44a9-a622-9754c4a00a89 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:25.307753 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-980d7e3f-4f79-44a9-a622-9754c4a00a89 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5542130 Dec 09 14:53:25.325008 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Request body: {'port': {'device_id': '81780f80-b704-4238-a626-320bce1e01af', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:53:25.379872 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:25.479700 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-8be8f717-3b07-4ad1-9006-3fe1d4bb1493 None None] Provisioning complete for port 65be3d81-a35f-4fa9-a69a-59deb88c6a80 triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:53:25.480286 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-8be8f717-3b07-4ad1-9006-3fe1d4bb1493 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:25.519073 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-8be8f717-3b07-4ad1-9006-3fe1d4bb1493 None None] Port 65be3d81-a35f-4fa9-a69a-59deb88c6a80 cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:53:25.854744 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d81b9001-d3c9-4d8e-8c5c-fc104d0b8977 req-9b9f41f9-c9da-4c6f-a83d-94e93105b3ad tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:25.858786 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d81b9001-d3c9-4d8e-8c5c-fc104d0b8977 req-9b9f41f9-c9da-4c6f-a83d-94e93105b3ad tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 932 time: 0.0538244 Dec 09 14:53:25.904045 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 65be3d81-a35f-4fa9-a69a-59deb88c6a80 {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:53:25.908912 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-d81b9001-d3c9-4d8e-8c5c-fc104d0b8977 req-8db289c7-67d7-4296-973b-5ab916a3982f tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439532 Dec 09 14:53:25.911915 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:25.924003 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Transition to ACTIVE for port object 65be3d81-a35f-4fa9-a69a-59deb88c6a80 will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:53:25.931784 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:25.986613 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Pushing event updated for resources: {'Port': ['ID=65be3d81-a35f-4fa9-a69a-59deb88c6a80,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:53:26.052166 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Attempting to bind port 65be3d81-a35f-4fa9-a69a-59deb88c6a80 on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:53:26.052506 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Attempting to bind port 65be3d81-a35f-4fa9-a69a-59deb88c6a80 by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:53:26.052840 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Attempting to bind port 65be3d81-a35f-4fa9-a69a-59deb88c6a80 on network 245ba82b-ada3-409a-912d-4462e3cd3ab8 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:53:26.057378 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Port 65be3d81-a35f-4fa9-a69a-59deb88c6a80 on network 245ba82b-ada3-409a-912d-4462e3cd3ab8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:53:26.057702 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Attempting to bind port 65be3d81-a35f-4fa9-a69a-59deb88c6a80 on network 245ba82b-ada3-409a-912d-4462e3cd3ab8 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:53:26.062682 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 53, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:53:26.063097 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Checking segment: {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:53:26.063480 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Bound using segment: {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:53:26.063940 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Bound port: 65be3d81-a35f-4fa9-a69a-59deb88c6a80, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:53:26.064299 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:26.132033 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] For port 65be3d81-a35f-4fa9-a69a-59deb88c6a80, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:53:26.135432 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] For port 65be3d81-a35f-4fa9-a69a-59deb88c6a80, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=65be3d81-a35f-4fa9-a69a-59deb88c6a80,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:53:26.140923 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:26.179399 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:26.180022 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:26.181429 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] 10.222.0.44 "PUT /v2.0/ports/65be3d81-a35f-4fa9-a69a-59deb88c6a80 HTTP/1.1" status: 200 len: 1094 time: 0.8608456 Dec 09 14:53:26.181843 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '81780f80-b704-4238-a626-320bce1e01af', 'tag': '65be3d81-a35f-4fa9-a69a-59deb88c6a80'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:53:26.184196 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-835ec702-1df8-49a4-a275-0e7a5672bc66" -d '{"events": [{"name": "network-changed", "server_uuid": "81780f80-b704-4238-a626-320bce1e01af", "tag": "65be3d81-a35f-4fa9-a69a-59deb88c6a80"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:53:26.211778 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c92cfd72-3431-43b1-93b1-f24e38f424ae service neutron] Pushing event updated for resources: {'Port': ['ID=65be3d81-a35f-4fa9-a69a-59deb88c6a80,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:53:26.232684 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:53:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1d06c584-95d4-49d2-a182-ef3d2179e158 x-openstack-request-id: req-1d06c584-95d4-49d2-a182-ef3d2179e158 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:53:26.232923 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "81780f80-b704-4238-a626-320bce1e01af", "tag": "65be3d81-a35f-4fa9-a69a-59deb88c6a80", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:53:26.233181 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-1d06c584-95d4-49d2-a182-ef3d2179e158 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:53:26.233589 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '81780f80-b704-4238-a626-320bce1e01af', 'tag': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'status': 'completed', 'code': 200} Dec 09 14:53:26.269011 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e16991b8-8667-4f18-a159-04110a83cce1 req-a631f9c9-e249-419a-9f3c-794d70fe92d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:26.270535 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-a631f9c9-e249-419a-9f3c-794d70fe92d2 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 1097 time: 0.0472438 Dec 09 14:53:26.315008 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-444f3e7e-5451-4eba-bdf3-fb74c196140e service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=65be3d81-a35f-4fa9-a69a-59deb88c6a80 HTTP/1.1" status: 200 len: 217 time: 0.0352778 Dec 09 14:53:26.374169 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e16991b8-8667-4f18-a159-04110a83cce1 req-f022b7c0-8988-4aa1-981f-8740f2ebb2ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:26.375778 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-f022b7c0-8988-4aa1-981f-8740f2ebb2ad service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0542557 Dec 09 14:53:26.422791 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e16991b8-8667-4f18-a159-04110a83cce1 req-53c4c493-ba0a-4401-9a88-d542095c1d8b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:26.424380 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-53c4c493-ba0a-4401-9a88-d542095c1d8b service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0419173 Dec 09 14:53:26.518261 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-6ee93ff6-7de8-44c4-98a8-84ae1d27f3fe service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864768 Dec 09 14:53:26.613595 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-e16991b8-8667-4f18-a159-04110a83cce1 req-081b3bfc-ddf4-4b96-bb94-64912afb75ac service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876856 Dec 09 14:53:26.710995 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835ec702-1df8-49a4-a275-0e7a5672bc66 req-bcd6e2fc-c047-4c44-8d50-afbddbc792c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:26.712888 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-835ec702-1df8-49a4-a275-0e7a5672bc66 req-bcd6e2fc-c047-4c44-8d50-afbddbc792c2 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 1097 time: 0.0498083 Dec 09 14:53:26.806482 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835ec702-1df8-49a4-a275-0e7a5672bc66 req-005ded92-979a-425b-acdb-10df9d11523d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:26.808095 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-835ec702-1df8-49a4-a275-0e7a5672bc66 req-005ded92-979a-425b-acdb-10df9d11523d service neutron] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 913 time: 0.0880704 Dec 09 14:53:26.852410 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-835ec702-1df8-49a4-a275-0e7a5672bc66 req-82e6112c-6fde-4637-b08b-f4a8dfd41b6c service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=65be3d81-a35f-4fa9-a69a-59deb88c6a80 HTTP/1.1" status: 200 len: 217 time: 0.0343790 Dec 09 14:53:26.901884 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835ec702-1df8-49a4-a275-0e7a5672bc66 req-3b19b2fe-c04d-4721-869a-89a60e1d02e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:26.903205 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-835ec702-1df8-49a4-a275-0e7a5672bc66 req-3b19b2fe-c04d-4721-869a-89a60e1d02e4 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0439537 Dec 09 14:53:26.953991 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835ec702-1df8-49a4-a275-0e7a5672bc66 req-b772144d-4a8b-43ed-a972-c727ec556178 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:26.955534 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-835ec702-1df8-49a4-a275-0e7a5672bc66 req-b772144d-4a8b-43ed-a972-c727ec556178 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0444067 Dec 09 14:53:27.020447 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-cad134b6-64fc-4e7b-b20c-33da0e6348dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:27.026290 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb6fa359-3cdb-4ac2-b57d-7d08b48e3891 req-ef676be4-5979-45cf-b468-e6249de281e2 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:27.031640 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-eb6fa359-3cdb-4ac2-b57d-7d08b48e3891 req-ef676be4-5979-45cf-b468-e6249de281e2 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 944 time: 0.0548630 Dec 09 14:53:27.048778 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-835ec702-1df8-49a4-a275-0e7a5672bc66 req-8fc12c49-6d19-43c7-8c73-c7ff20d11d9e service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0858040 Dec 09 14:53:27.080551 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-eb6fa359-3cdb-4ac2-b57d-7d08b48e3891 req-c617c733-f277-4be7-8579-62d9ee6a54ce tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462623 Dec 09 14:53:27.145476 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-835ec702-1df8-49a4-a275-0e7a5672bc66 req-f120d288-f616-41cd-96f4-307d63d9353a service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0896432 Dec 09 14:53:28.209829 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27e5dbe5-f02c-4c7f-8f29-d5ccb3a78ecb req-2c5409eb-484d-4b97-99ae-22bfaa0c54f2 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:28.211277 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-27e5dbe5-f02c-4c7f-8f29-d5ccb3a78ecb req-2c5409eb-484d-4b97-99ae-22bfaa0c54f2 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 944 time: 0.0526955 Dec 09 14:53:28.263366 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-27e5dbe5-f02c-4c7f-8f29-d5ccb3a78ecb req-820c9160-e97e-474f-bb08-e8c40d76949e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435128 Dec 09 14:53:29.183164 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-cad2d9aa-f4ea-44d7-b0b0-3f219ecdbe07 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:29.390403 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-331b8900-2c0e-4f30-b387-e76213c5cf80 req-538eff5e-97c9-4dad-8371-710d58e99a53 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:29.391909 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-331b8900-2c0e-4f30-b387-e76213c5cf80 req-538eff5e-97c9-4dad-8371-710d58e99a53 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 944 time: 0.0578208 Dec 09 14:53:29.442889 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-331b8900-2c0e-4f30-b387-e76213c5cf80 req-d3947415-21fe-45ef-9dbc-2ef8cafe6829 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448916 Dec 09 14:53:30.474446 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:30.568302 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30f06d71-053b-42b0-b665-e100cd9c599a req-8484a97c-628f-40c1-a21d-a5439c9de7f4 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:30.569794 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-30f06d71-053b-42b0-b665-e100cd9c599a req-8484a97c-628f-40c1-a21d-a5439c9de7f4 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 944 time: 0.0555918 Dec 09 14:53:30.618634 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-30f06d71-053b-42b0-b665-e100cd9c599a req-4e1390b0-9171-4600-89c8-87637d7a6d47 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427573 Dec 09 14:53:31.750293 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d0a8788-fce5-4b93-9e6f-27b1cdf3b4b4 req-f643f03c-d552-4fb0-ac78-99edfc94d580 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:31.751835 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3d0a8788-fce5-4b93-9e6f-27b1cdf3b4b4 req-f643f03c-d552-4fb0-ac78-99edfc94d580 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 944 time: 0.0527461 Dec 09 14:53:31.804382 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-3d0a8788-fce5-4b93-9e6f-27b1cdf3b4b4 req-67458148-9d94-466f-9aa3-506d471a92fb tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458004 Dec 09 14:53:31.840061 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:32.615855 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:32.942770 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c6dd66-3ae5-47c1-a16a-e45ce656e020 req-445507f1-99c3-489e-93a3-f4be7f91d05d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:32.944204 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a5c6dd66-3ae5-47c1-a16a-e45ce656e020 req-445507f1-99c3-489e-93a3-f4be7f91d05d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 944 time: 0.0617285 Dec 09 14:53:32.995833 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-a5c6dd66-3ae5-47c1-a16a-e45ce656e020 req-a53fe7db-55d9-4973-9c08-7be0de9761e1 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450768 Dec 09 14:53:34.116455 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-befa3f09-6d2a-49e9-abf2-aa39c25bf702 req-78ab6357-50cc-4895-b10d-7d3895669e10 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:34.117935 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-befa3f09-6d2a-49e9-abf2-aa39c25bf702 req-78ab6357-50cc-4895-b10d-7d3895669e10 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 944 time: 0.0543571 Dec 09 14:53:34.170812 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-befa3f09-6d2a-49e9-abf2-aa39c25bf702 req-e0607f6a-1080-429c-9574-b4cec2104785 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436389 Dec 09 14:53:34.256565 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 65be3d81-a35f-4fa9-a69a-59deb88c6a80 details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:53:34.369243 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 65be3d81-a35f-4fa9-a69a-59deb88c6a80, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=65be3d81-a35f-4fa9-a69a-59deb88c6a80,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:53:34.380419 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'port_id': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'mac_address': 'fa:16:3e:54:41:ca', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 400, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:53:34.421774 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:34.435429 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 65be3d81-a35f-4fa9-a69a-59deb88c6a80 {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:53:34.455938 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 65be3d81-a35f-4fa9-a69a-59deb88c6a80, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=65be3d81-a35f-4fa9-a69a-59deb88c6a80,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:53:34.464822 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:34.515242 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=65be3d81-a35f-4fa9-a69a-59deb88c6a80,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:53:34.522970 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:34.523331 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:34.523724 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:34.524086 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:34.524406 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:34.524746 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:34.525092 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:34.525425 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:34.525759 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:34.526100 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:34.526425 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:34.526753 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:34.527078 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:34.670914 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['65be3d81-a35f-4fa9-a69a-59deb88c6a80'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:53:35.303399 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abddaf8e-f28f-4673-b0c1-05758bd5c2b3 req-3da24eae-7318-4b53-abba-7e23bf8e5134 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:35.305114 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-abddaf8e-f28f-4673-b0c1-05758bd5c2b3 req-3da24eae-7318-4b53-abba-7e23bf8e5134 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 945 time: 0.0502355 Dec 09 14:53:35.355171 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-abddaf8e-f28f-4673-b0c1-05758bd5c2b3 req-b603f321-2b17-4fc3-987d-c11e43205d67 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441279 Dec 09 14:53:36.272297 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 65be3d81-a35f-4fa9-a69a-59deb88c6a80 up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:53:36.337271 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port 65be3d81-a35f-4fa9-a69a-59deb88c6a80 completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:53:36.341206 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port 65be3d81-a35f-4fa9-a69a-59deb88c6a80 triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:53:36.341584 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:36.426024 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:36.449733 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '81780f80-b704-4238-a626-320bce1e01af', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '65be3d81-a35f-4fa9-a69a-59deb88c6a80'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:53:36.452073 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-199f1ba5-f97c-4b44-bf6a-44ee1eaee526" -d '{"events": [{"server_uuid": "81780f80-b704-4238-a626-320bce1e01af", "name": "network-vif-plugged", "status": "completed", "tag": "65be3d81-a35f-4fa9-a69a-59deb88c6a80"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:53:36.466389 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 65be3d81-a35f-4fa9-a69a-59deb88c6a80, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=65be3d81-a35f-4fa9-a69a-59deb88c6a80,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:53:36.472458 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:36.475260 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f00cf72-baf8-4f1a-a1b2-485bfff2a52c req-37c8b20d-a796-40c5-ab47-d08e10eda539 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:36.477581 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5f00cf72-baf8-4f1a-a1b2-485bfff2a52c req-37c8b20d-a796-40c5-ab47-d08e10eda539 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 945 time: 0.0542800 Dec 09 14:53:36.531161 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=65be3d81-a35f-4fa9-a69a-59deb88c6a80,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:53:36.532631 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-5f00cf72-baf8-4f1a-a1b2-485bfff2a52c req-827c51b4-acd0-42c6-8930-9d403b35d67c tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472846 Dec 09 14:53:36.558575 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:53:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c8f4ea9-f115-41f5-a907-50c8e8fcd3cd x-openstack-request-id: req-4c8f4ea9-f115-41f5-a907-50c8e8fcd3cd {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:53:36.558918 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "81780f80-b704-4238-a626-320bce1e01af", "name": "network-vif-plugged", "status": "completed", "tag": "65be3d81-a35f-4fa9-a69a-59deb88c6a80", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:53:36.559172 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-4c8f4ea9-f115-41f5-a907-50c8e8fcd3cd {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:53:36.559595 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '81780f80-b704-4238-a626-320bce1e01af', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'code': 200} Dec 09 14:53:36.782265 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711e6788-b9dd-4b48-a211-67da59fc5dbc req-3467e0b0-80fe-4edf-831c-4bde640fc460 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:36.783715 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-711e6788-b9dd-4b48-a211-67da59fc5dbc req-3467e0b0-80fe-4edf-831c-4bde640fc460 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 1099 time: 0.0420513 Dec 09 14:53:36.834465 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-711e6788-b9dd-4b48-a211-67da59fc5dbc req-69dda510-2869-486c-8bb4-90a99c1dfdbe service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441122 Dec 09 14:53:37.653461 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-712116b6-9563-4ad7-ab84-6543a67243fe req-0126e671-c56e-424a-a999-e576052ec30b tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:37.654950 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-712116b6-9563-4ad7-ab84-6543a67243fe req-0126e671-c56e-424a-a999-e576052ec30b tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 946 time: 0.0493336 Dec 09 14:53:37.708741 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-712116b6-9563-4ad7-ab84-6543a67243fe req-504a0527-e5da-4921-b7fb-f618cee921fc tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464892 Dec 09 14:53:38.835881 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34198a1a-119a-49d7-b050-378c0cde6a4d req-25a49b1f-6d17-46df-a184-5aeb9c6d981d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:38.837348 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-34198a1a-119a-49d7-b050-378c0cde6a4d req-25a49b1f-6d17-46df-a184-5aeb9c6d981d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 946 time: 0.0503371 Dec 09 14:53:38.886219 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-34198a1a-119a-49d7-b050-378c0cde6a4d req-89425fad-c6a8-44a9-92a7-e7330293e864 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427790 Dec 09 14:53:39.013209 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcb8f092-d190-4362-9e8f-18dd50a9b7c6 req-31eb17f0-f795-4bca-853f-5a1650ebcb6e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:39.014652 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-dcb8f092-d190-4362-9e8f-18dd50a9b7c6 req-31eb17f0-f795-4bca-853f-5a1650ebcb6e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 946 time: 0.0540948 Dec 09 14:53:39.063866 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-dcb8f092-d190-4362-9e8f-18dd50a9b7c6 req-fd90cd5c-71c2-43e1-9596-e21d3c77ab95 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431385 Dec 09 14:53:39.085977 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34542) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:53:39.127399 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c34e9cd4-a92c-4065-94eb-6b4dbfbcacc6 tempest-TestVolumeBootPattern-769977608 tempest-TestVolumeBootPattern-769977608-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:39.129016 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-c34e9cd4-a92c-4065-94eb-6b4dbfbcacc6 tempest-TestVolumeBootPattern-769977608 tempest-TestVolumeBootPattern-769977608-project-admin] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 1094 time: 0.0420907 Dec 09 14:53:39.132947 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34544) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:53:39.137262 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Request body: {'floatingip': {'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'port_id': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address': '172.20.0.13'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:53:39.160997 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for floatingip, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:39.266181 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:39.374077 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Allocated IP 172.27.0.248 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/0f6c05f1-e085-4935-b84a-8f1c5f6c7793) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:53:39.478044 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:39.514457 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:39.550763 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:53:39.556881 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:53:39.561168 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:53:39.564110 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'Port': ['ID=0f6c05f1-e085-4935-b84a-8f1c5f6c7793,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:53:39.588650 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:39.588996 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:39.589338 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:39.589687 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:39.590001 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:39.590330 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:39.590658 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:39.590987 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:39.591316 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:39.591636 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:39.591985 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:39.592308 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:39.592604 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:53:39.933371 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:40.001857 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:40.148749 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:40.155260 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-130461426'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:40.218897 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'Port': ['ID=0f6c05f1-e085-4935-b84a-8f1c5f6c7793,revision_number=2']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:53:40.236027 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:40.339724 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.l3_db [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Floating IP 503721b7-6546-41f1-a3cc-46b507f13a1e associated. External IP: 172.27.0.248, port: 65be3d81-a35f-4fa9-a69a-59deb88c6a80. Dec 09 14:53:40.807360 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Router 0afa8c36-934f-4ee2-8457-fb4e00214c4d has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:53:40.911639 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:53:40.921524 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea317b75-bd95-4aa7-95e7-98599d883da2 None None] Sync routers for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:53:40.931997 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:40.932188 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea317b75-bd95-4aa7-95e7-98599d883da2 None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:53:40.932612 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-ea317b75-bd95-4aa7-95e7-98599d883da2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:53:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:53:40.961533 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-69fec5d0-612d-4058-b7c6-ac61b47f9466 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.8275857 Dec 09 14:53:40.962187 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '81780f80-b704-4238-a626-320bce1e01af', 'tag': '65be3d81-a35f-4fa9-a69a-59deb88c6a80'}] {{(pid=109062) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:53:40.964425 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3f1ec408b0eec5a36b56e0a757eff0f4875d9a95eff62f4d0b4a62bb27a3b600" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9d8f4aa1-a350-49d4-a841-b31e36a6a2c9" -d '{"events": [{"name": "network-changed", "server_uuid": "81780f80-b704-4238-a626-320bce1e01af", "tag": "65be3d81-a35f-4fa9-a69a-59deb88c6a80"}]}' {{(pid=109062) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:53:41.000387 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:53:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5c4da2be-b695-4a75-85ab-201ce128001a x-openstack-request-id: req-5c4da2be-b695-4a75-85ab-201ce128001a {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:53:41.000686 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "81780f80-b704-4238-a626-320bce1e01af", "tag": "65be3d81-a35f-4fa9-a69a-59deb88c6a80", "status": "completed", "code": 200}]} {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:53:41.000942 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-5c4da2be-b695-4a75-85ab-201ce128001a {{(pid=109062) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:53:41.001346 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '81780f80-b704-4238-a626-320bce1e01af', 'tag': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'status': 'completed', 'code': 200} Dec 09 14:53:41.045452 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-ea317b75-bd95-4aa7-95e7-98599d883da2 None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:53:41.062623 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d8f4aa1-a350-49d4-a841-b31e36a6a2c9 req-57d1f1e3-c743-4030-9d0b-4c00ca1da500 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:41.064133 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d8f4aa1-a350-49d4-a841-b31e36a6a2c9 req-57d1f1e3-c743-4030-9d0b-4c00ca1da500 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 1099 time: 0.0406330 Dec 09 14:53:41.159949 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d8f4aa1-a350-49d4-a841-b31e36a6a2c9 req-8e037b51-2265-41ca-8f58-0f503f471249 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:41.161469 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d8f4aa1-a350-49d4-a841-b31e36a6a2c9 req-8e037b51-2265-41ca-8f58-0f503f471249 service neutron] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 913 time: 0.0886393 Dec 09 14:53:41.226958 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d8f4aa1-a350-49d4-a841-b31e36a6a2c9 req-2110a113-9d62-49fd-aa71-6a9c3ed456d8 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=65be3d81-a35f-4fa9-a69a-59deb88c6a80 HTTP/1.1" status: 200 len: 1000 time: 0.0581560 Dec 09 14:53:41.267154 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-ea317b75-bd95-4aa7-95e7-98599d883da2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '503721b7-6546-41f1-a3cc-46b507f13a1e', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'floating_ip_address': '172.27.0.248', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'port_id': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'mac_address': 'fa:16:3e:54:41:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81780f80-b704-4238-a626-320bce1e01af', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:53:39Z', 'updated_at': '2021-12-09T14:53:39Z', 'revision_number': 0, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:53:41.283600 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d8f4aa1-a350-49d4-a841-b31e36a6a2c9 req-d9c07690-c5a3-455a-adfd-356dbf1737ca service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:41.285107 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d8f4aa1-a350-49d4-a841-b31e36a6a2c9 req-d9c07690-c5a3-455a-adfd-356dbf1737ca service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0502839 Dec 09 14:53:41.292827 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea317b75-bd95-4aa7-95e7-98599d883da2 None None] Checking router: 0afa8c36-934f-4ee2-8457-fb4e00214c4d for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:53:41.301390 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ea317b75-bd95-4aa7-95e7-98599d883da2 None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:53:41.302001 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-ea317b75-bd95-4aa7-95e7-98599d883da2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:53:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:53:41.330190 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d8f4aa1-a350-49d4-a841-b31e36a6a2c9 req-e2319315-6231-49ef-b821-750e0b773843 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:41.331721 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d8f4aa1-a350-49d4-a841-b31e36a6a2c9 req-e2319315-6231-49ef-b821-750e0b773843 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0397601 Dec 09 14:53:41.409201 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-ea317b75-bd95-4aa7-95e7-98599d883da2 None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:53:41.421812 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d8f4aa1-a350-49d4-a841-b31e36a6a2c9 req-65f1842b-2474-4bdd-aaaf-ab56be50a64e service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830040 Dec 09 14:53:41.513954 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-9d8f4aa1-a350-49d4-a841-b31e36a6a2c9 req-50430555-ed6e-426d-b7e2-a39a80994a30 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0855200 Dec 09 14:53:41.630381 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-ea317b75-bd95-4aa7-95e7-98599d883da2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '503721b7-6546-41f1-a3cc-46b507f13a1e', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'floating_ip_address': '172.27.0.248', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'port_id': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'mac_address': 'fa:16:3e:54:41:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81780f80-b704-4238-a626-320bce1e01af', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:53:39Z', 'updated_at': '2021-12-09T14:53:39Z', 'revision_number': 0, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:53:41.656354 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea317b75-bd95-4aa7-95e7-98599d883da2 None None] The sync data for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi is: [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '503721b7-6546-41f1-a3cc-46b507f13a1e', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'floating_ip_address': '172.27.0.248', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'port_id': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'mac_address': 'fa:16:3e:54:41:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81780f80-b704-4238-a626-320bce1e01af', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:53:39Z', 'updated_at': '2021-12-09T14:53:39Z', 'revision_number': 0, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:53:41.859125 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-46adedbf-c490-4d5d-b240-7c838e98ad2a None None] New status for floating IP 503721b7-6546-41f1-a3cc-46b507f13a1e: ACTIVE {{(pid=109064) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:53:44.919300 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:51.132727 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cc3f230a-47ea-4b24-99c0-21c7bb90bc44 req-0dc4799b-3afd-47c0-9de1-3aa8e580d4a3 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0423846 Dec 09 14:53:51.219303 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc3f230a-47ea-4b24-99c0-21c7bb90bc44 req-6dee5bff-2202-4958-96bb-5181d453b721 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:51.220816 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cc3f230a-47ea-4b24-99c0-21c7bb90bc44 req-6dee5bff-2202-4958-96bb-5181d453b721 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 1099 time: 0.0416071 Dec 09 14:53:51.327300 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc3f230a-47ea-4b24-99c0-21c7bb90bc44 req-88fe8171-e865-43c9-9f64-78101b7810fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:51.328692 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cc3f230a-47ea-4b24-99c0-21c7bb90bc44 req-88fe8171-e865-43c9-9f64-78101b7810fd service neutron] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 913 time: 0.0871544 Dec 09 14:53:51.394465 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cc3f230a-47ea-4b24-99c0-21c7bb90bc44 req-ce9fc97e-827e-46ea-a820-dc9ba78e4bae service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=65be3d81-a35f-4fa9-a69a-59deb88c6a80 HTTP/1.1" status: 200 len: 1002 time: 0.0578752 Dec 09 14:53:51.454393 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc3f230a-47ea-4b24-99c0-21c7bb90bc44 req-ddfb5d3e-11e0-491e-917a-b59c03e8b44f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:51.455867 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cc3f230a-47ea-4b24-99c0-21c7bb90bc44 req-ddfb5d3e-11e0-491e-917a-b59c03e8b44f service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0529692 Dec 09 14:53:51.503194 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc3f230a-47ea-4b24-99c0-21c7bb90bc44 req-80ffb8b1-f08a-4e5d-9d35-431947763084 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:53:51.504744 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cc3f230a-47ea-4b24-99c0-21c7bb90bc44 req-80ffb8b1-f08a-4e5d-9d35-431947763084 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0418377 Dec 09 14:53:51.595425 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cc3f230a-47ea-4b24-99c0-21c7bb90bc44 req-31f176b8-a822-4be1-b78f-895a04041d4c service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0825515 Dec 09 14:53:51.697526 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-cc3f230a-47ea-4b24-99c0-21c7bb90bc44 req-30e22861-36be-4972-a54c-983bb8909927 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0926809 Dec 09 14:53:55.465565 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:53:57.033968 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-96666bc2-8aee-4a29-b929-eea37bab24ff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:53:59.184275 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-665a0707-253f-4211-af7a-c93838bde849 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:54:00.480376 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:54:01.843347 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:54:02.607081 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:54:14.916880 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:54:27.038164 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-d913b0a3-5bc0-48d4-9aac-6381c88299a1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:54:29.189863 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-38aee17e-dec9-441f-9591-5322a0270cb2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:54:30.485297 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:54:31.845967 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:54:32.470465 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:54:32.614436 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:54:44.932325 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:54:51.669462 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93f52126-b46b-44fd-bde4-b57d1633b3a4 req-e150e9d2-ac16-4fe8-82ea-ae1c0d84502f service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0453227 Dec 09 14:54:51.751269 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93f52126-b46b-44fd-bde4-b57d1633b3a4 req-6eb952bf-1f06-48b3-8073-953a4efb0fa1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:54:51.752785 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93f52126-b46b-44fd-bde4-b57d1633b3a4 req-6eb952bf-1f06-48b3-8073-953a4efb0fa1 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 1099 time: 0.0414000 Dec 09 14:54:51.860495 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93f52126-b46b-44fd-bde4-b57d1633b3a4 req-2cdab70f-729c-4a35-aa5e-4c0e8efb8908 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:54:51.861987 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93f52126-b46b-44fd-bde4-b57d1633b3a4 req-2cdab70f-729c-4a35-aa5e-4c0e8efb8908 service neutron] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 913 time: 0.0879247 Dec 09 14:54:51.927583 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93f52126-b46b-44fd-bde4-b57d1633b3a4 req-41d88e35-a07b-474e-a389-d8c2e776829e service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=65be3d81-a35f-4fa9-a69a-59deb88c6a80 HTTP/1.1" status: 200 len: 1002 time: 0.0582180 Dec 09 14:54:51.979809 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93f52126-b46b-44fd-bde4-b57d1633b3a4 req-bc6a8d89-d994-4dae-b015-8a7c9d3eb09b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:54:51.981241 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93f52126-b46b-44fd-bde4-b57d1633b3a4 req-bc6a8d89-d994-4dae-b015-8a7c9d3eb09b service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0468857 Dec 09 14:54:52.028659 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93f52126-b46b-44fd-bde4-b57d1633b3a4 req-83698d50-1166-411a-b18c-188718a4ec99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:54:52.030094 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93f52126-b46b-44fd-bde4-b57d1633b3a4 req-83698d50-1166-411a-b18c-188718a4ec99 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0413375 Dec 09 14:54:52.117064 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93f52126-b46b-44fd-bde4-b57d1633b3a4 req-d933f66b-bb2b-4650-b234-7f5751ca605f service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0799463 Dec 09 14:54:52.212351 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-93f52126-b46b-44fd-bde4-b57d1633b3a4 req-f6680d54-1191-4949-99c9-27bee457b373 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872076 Dec 09 14:54:57.038719 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-197d68ab-e8b4-4056-8ecf-c25c4db4d89c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:54:59.181980 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-9e2890ae-0b00-4135-81d8-06ddad86c26a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:00.486397 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:01.857934 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:02.610651 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:09.476969 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:55:14.935176 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:21.214421 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-1a8bd329-8042-4f87-be16-20300d74ff19 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1578162193&fields=id&tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0 HTTP/1.1" status: 200 len: 267 time: 0.0525570 Dec 09 14:55:21.327509 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fab94aff-2830-4fc9-b553-c0785261070f req-569707a5-81eb-4a7f-af9a-c6d7b784217f tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:21.329001 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-569707a5-81eb-4a7f-af9a-c6d7b784217f tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 812 time: 0.1078007 Dec 09 14:55:21.350660 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-0e1c688c-c567-4edc-9bc9-2110ab50861d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/quotas/9e02a1db560b45ddbee50b9e57d1f4f0 HTTP/1.1" status: 200 len: 375 time: 0.0135529 Dec 09 14:55:21.410122 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-122c0d3a-7001-49de-adc1-d878f81ae5de tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0512462 Dec 09 14:55:21.472384 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-98824c91-c8b9-44d2-b5e8-a116b8aaac3f service neutron] http://10.222.0.39:9696/v2.0/extensions returned with HTTP 200 {{(pid=109062) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Dec 09 14:55:21.473398 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-98824c91-c8b9-44d2-b5e8-a116b8aaac3f service neutron] 10.222.0.39 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0512474 Dec 09 14:55:21.560929 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-2483c3ec-6f77-4148-aed3-c064221dc8f9 service neutron] 10.222.0.39 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0812867 Dec 09 14:55:21.669451 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-f38444a5-1230-4275-96ec-e279cd3ecc6b service neutron] 10.222.0.39 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1023748 Dec 09 14:55:21.960529 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-124a0afd-d5b6-449c-8072-962416369817 req-7ea89fda-edea-49cf-af84-7be4e295a4e3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 210 time: 0.0274208 Dec 09 14:55:22.943100 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fab94aff-2830-4fc9-b553-c0785261070f req-dc344bb0-de87-4751-8ab1-0d6f6e471590 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:22.944773 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-dc344bb0-de87-4751-8ab1-0d6f6e471590 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 812 time: 0.1051238 Dec 09 14:55:23.010618 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-1edaf7a3-3b97-4fe0-a17c-e889800875cb tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.44 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0 HTTP/1.1" status: 200 len: 380 time: 0.0557048 Dec 09 14:55:23.021624 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-fab94aff-2830-4fc9-b553-c0785261070f req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Request body: {'port': {'device_id': '6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'admin_state_up': True, 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'security_groups': ['97e4de8e-53ca-4a2a-af5b-2f037e0d4f04']}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:55:23.053213 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-900b6891-9a4e-4514-9be2-6f3f61269974 req-d61cc84d-3830-4ac5-8e5b-3d2ae35c46d3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 210 time: 0.0263917 Dec 09 14:55:23.133218 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fab94aff-2830-4fc9-b553-c0785261070f req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Made reservation on behalf of 9e02a1db560b45ddbee50b9e57d1f4f0 for: {'port': 1} {{(pid=109061) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Dec 09 14:55:23.136899 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-fab94aff-2830-4fc9-b553-c0785261070f req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:23.267514 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_common [req-fab94aff-2830-4fc9-b553-c0785261070f req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Allocated IP 172.20.0.5 (245ba82b-ada3-409a-912d-4462e3cd3ab8/548e3893-a447-4905-aa48-fd4e75373585/0ab04229-2972-425f-b569-020d6d04388d) {{(pid=109061) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:55:23.409123 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-fab94aff-2830-4fc9-b553-c0785261070f req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for port, precommit_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:23.443863 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-fab94aff-2830-4fc9-b553-c0785261070f req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_create {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:23.486968 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fab94aff-2830-4fc9-b553-c0785261070f req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Network 245ba82b-ada3-409a-912d-4462e3cd3ab8 is already hosted by enough agents. {{(pid=109061) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:55:23.491908 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.base_scheduler [req-fab94aff-2830-4fc9-b553-c0785261070f req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Resources bound (agent type, host, resource id): {{(pid=109061) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:55:23.495866 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-fab94aff-2830-4fc9-b553-c0785261070f req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Received port after_create {{(pid=109061) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:55:23.519507 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'Port': ['ID=0ab04229-2972-425f-b569-020d6d04388d,revision_number=1']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:55:23.531868 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:23.532234 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:23.532537 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:23.532894 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:23.533223 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:23.533550 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:23.533849 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:23.534175 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:23.534499 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:23.534841 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:23.535165 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:23.535737 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:23.536136 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:23.559583 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fab94aff-2830-4fc9-b553-c0785261070f req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:23.560141 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-fab94aff-2830-4fc9-b553-c0785261070f req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:23.577868 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-35b0c5eb-eb9b-4b19-b7ed-c6a09f7e0bab tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.44 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5604095 Dec 09 14:55:23.590534 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.v2.base [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Request body: {'port': {'device_id': '6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81969'}} {{(pid=109061) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:55:23.650346 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:23.764568 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-c890bf6c-334a-423a-bfba-8326dedd995c None None] Provisioning complete for port 0ab04229-2972-425f-b569-020d6d04388d triggered by entity DHCP. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:55:23.765200 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-c890bf6c-334a-423a-bfba-8326dedd995c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:23.798749 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-c890bf6c-334a-423a-bfba-8326dedd995c None None] Port 0ab04229-2972-425f-b569-020d6d04388d cannot update to ACTIVE because it is not bound. {{(pid=109063) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Dec 09 14:55:23.906333 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0ab04229-2972-425f-b569-020d6d04388d {{(pid=109061) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:55:23.913866 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Publish callbacks [] for port, precommit_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:23.925915 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.provisioning_blocks [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Transition to ACTIVE for port object 0ab04229-2972-425f-b569-020d6d04388d will not be triggered until provisioned by entity L2. {{(pid=109061) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Dec 09 14:55:23.932700 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:23.981332 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Pushing event updated for resources: {'Port': ['ID=0ab04229-2972-425f-b569-020d6d04388d,revision_number=2']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:55:24.052526 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Attempting to bind port 0ab04229-2972-425f-b569-020d6d04388d on host hv-cinder-81969 for vnic_type normal with profile {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Dec 09 14:55:24.053172 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Attempting to bind port 0ab04229-2972-425f-b569-020d6d04388d by drivers openvswitch,hyperv on host hv-cinder-81969 at level 0 using segments [{'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Dec 09 14:55:24.053172 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Attempting to bind port 0ab04229-2972-425f-b569-020d6d04388d on network 245ba82b-ada3-409a-912d-4462e3cd3ab8 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:55:24.057580 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Port 0ab04229-2972-425f-b569-020d6d04388d on network 245ba82b-ada3-409a-912d-4462e3cd3ab8 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81969 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Dec 09 14:55:24.057888 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Attempting to bind port 0ab04229-2972-425f-b569-020d6d04388d on network 245ba82b-ada3-409a-912d-4462e3cd3ab8 {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Dec 09 14:55:24.063013 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Checking agent: {'id': '3f7003c3-68a8-4c94-8e2f-64941e191e27', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81969', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'started_at': datetime.datetime(2021, 12, 9, 14, 40, 44), 'heartbeat_timestamp': datetime.datetime(2021, 12, 9, 14, 55, 15), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Dec 09 14:55:24.063356 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Checking segment: {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=109061) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Dec 09 14:55:24.063780 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Bound using segment: {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'} {{(pid=109061) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Dec 09 14:55:24.064214 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.managers [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Bound port: 0ab04229-2972-425f-b569-020d6d04388d, host: hv-cinder-81969, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a705bcc4-c3b3-42a8-bec6-657a4661427a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 400, 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8'}}] {{(pid=109061) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Dec 09 14:55:24.064577 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:24.140109 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] For port 0ab04229-2972-425f-b569-020d6d04388d, host hv-cinder-81969, cleared binding levels {{(pid=109061) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Dec 09 14:55:24.165465 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] For port 0ab04229-2972-425f-b569-020d6d04388d, host hv-cinder-81969, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0ab04229-2972-425f-b569-020d6d04388d,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109061) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Dec 09 14:55:24.171767 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-133412101'] for port, after_update {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:24.211162 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:24.211833 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:24.213200 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] 10.222.0.44 "PUT /v2.0/ports/0ab04229-2972-425f-b569-020d6d04388d HTTP/1.1" status: 200 len: 1093 time: 0.6270256 Dec 09 14:55:24.214419 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab', 'tag': '0ab04229-2972-425f-b569-020d6d04388d'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:55:24.216611 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-31374823-fc58-4c68-b8d2-0e242b20e9c2" -d '{"events": [{"name": "network-changed", "server_uuid": "6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab", "tag": "0ab04229-2972-425f-b569-020d6d04388d"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:55:24.230162 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49026aa3-082e-4ae7-8580-b9b21ffd77ca req-e315084f-025e-498b-bffd-bf13c7cd410e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:24.231886 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-49026aa3-082e-4ae7-8580-b9b21ffd77ca req-e315084f-025e-498b-bffd-bf13c7cd410e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 943 time: 0.1057932 Dec 09 14:55:24.251972 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a249862a-e698-4428-ba36-40b5e334ebd8 service neutron] Pushing event updated for resources: {'Port': ['ID=0ab04229-2972-425f-b569-020d6d04388d,revision_number=3']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:55:24.257798 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:55:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b7eaf81e-2dc0-4fdb-8686-11488fa3bded x-openstack-request-id: req-b7eaf81e-2dc0-4fdb-8686-11488fa3bded {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:55:24.258117 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab", "tag": "0ab04229-2972-425f-b569-020d6d04388d", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:55:24.258338 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-b7eaf81e-2dc0-4fdb-8686-11488fa3bded {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:55:24.258734 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab', 'tag': '0ab04229-2972-425f-b569-020d6d04388d', 'status': 'completed', 'code': 200} Dec 09 14:55:24.329870 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-49026aa3-082e-4ae7-8580-b9b21ffd77ca req-bb39dead-5fdf-4db6-8e73-c51cbb2a0091 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0746155 Dec 09 14:55:24.338418 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fab94aff-2830-4fc9-b553-c0785261070f req-5ccd95b7-1f8d-420d-abdf-9aa1a7adaee9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:24.339906 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-5ccd95b7-1f8d-420d-abdf-9aa1a7adaee9 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 1096 time: 0.0666170 Dec 09 14:55:24.384593 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-f688d65c-c85d-4306-b9fb-7677c8da304d service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0ab04229-2972-425f-b569-020d6d04388d HTTP/1.1" status: 200 len: 217 time: 0.0362477 Dec 09 14:55:24.436966 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fab94aff-2830-4fc9-b553-c0785261070f req-f7e6a5e1-3e7a-4204-9796-4d37f03da949 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:24.438440 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-f7e6a5e1-3e7a-4204-9796-4d37f03da949 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0475829 Dec 09 14:55:24.484696 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fab94aff-2830-4fc9-b553-c0785261070f req-8d25607f-f38a-4b41-a943-e4468b16410e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:24.486211 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-8d25607f-f38a-4b41-a943-e4468b16410e service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0408058 Dec 09 14:55:24.578110 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-69bf551d-d5b6-4812-b355-ae360f4dcab7 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0848141 Dec 09 14:55:24.678257 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-fab94aff-2830-4fc9-b553-c0785261070f req-24d5db7c-5852-4a9f-b8f7-2a20f5f0c97f service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0931628 Dec 09 14:55:24.771311 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31374823-fc58-4c68-b8d2-0e242b20e9c2 req-4ea8f3d8-20bc-4377-9e6a-5f2e2e05178c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:24.772823 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-31374823-fc58-4c68-b8d2-0e242b20e9c2 req-4ea8f3d8-20bc-4377-9e6a-5f2e2e05178c service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 1096 time: 0.0424724 Dec 09 14:55:24.866694 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31374823-fc58-4c68-b8d2-0e242b20e9c2 req-0517ae52-13a3-4cee-83e8-e88a695b6b8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:24.868069 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-31374823-fc58-4c68-b8d2-0e242b20e9c2 req-0517ae52-13a3-4cee-83e8-e88a695b6b8e service neutron] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 913 time: 0.0872788 Dec 09 14:55:24.910809 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-31374823-fc58-4c68-b8d2-0e242b20e9c2 req-4645bfb0-1826-4326-be05-6018cc89ebec service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0ab04229-2972-425f-b569-020d6d04388d HTTP/1.1" status: 200 len: 217 time: 0.0340271 Dec 09 14:55:24.961407 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31374823-fc58-4c68-b8d2-0e242b20e9c2 req-fa1bb836-5f6a-4a44-a32f-6f539aabe400 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:24.962809 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-31374823-fc58-4c68-b8d2-0e242b20e9c2 req-fa1bb836-5f6a-4a44-a32f-6f539aabe400 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0421441 Dec 09 14:55:25.012850 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31374823-fc58-4c68-b8d2-0e242b20e9c2 req-e2173616-d1bf-4f51-b35f-a7003c1cd434 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:25.014373 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-31374823-fc58-4c68-b8d2-0e242b20e9c2 req-e2173616-d1bf-4f51-b35f-a7003c1cd434 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0428398 Dec 09 14:55:25.106140 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-31374823-fc58-4c68-b8d2-0e242b20e9c2 req-be4479bf-0761-49e9-806f-a1f13de35f51 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0799496 Dec 09 14:55:25.207364 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-31374823-fc58-4c68-b8d2-0e242b20e9c2 req-b43277ca-24dc-4911-8b90-8fce5e88cb74 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0864038 Dec 09 14:55:25.458980 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ad6ee9b-2cbe-4c31-b8f3-d55f15b86030 req-2a65682e-d52e-4c81-8eb6-fe8380a01c8a tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:25.460379 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6ad6ee9b-2cbe-4c31-b8f3-d55f15b86030 req-2a65682e-d52e-4c81-8eb6-fe8380a01c8a tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 943 time: 0.0516524 Dec 09 14:55:25.509250 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-6ad6ee9b-2cbe-4c31-b8f3-d55f15b86030 req-a2fef69d-d8c8-4040-8721-0deba76ad1a3 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428877 Dec 09 14:55:26.640004 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7795abe9-8ac4-4054-966a-3ad6a5b9b500 req-97d96492-387c-4e27-a590-d6131a381691 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:26.641469 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7795abe9-8ac4-4054-966a-3ad6a5b9b500 req-97d96492-387c-4e27-a590-d6131a381691 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 943 time: 0.0598121 Dec 09 14:55:26.693657 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-7795abe9-8ac4-4054-966a-3ad6a5b9b500 req-93421552-8b8a-48a5-b505-cdf862151601 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432677 Dec 09 14:55:27.039908 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f19b0c96-045b-4c7c-bebb-7b9f1c087a41 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:27.810148 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53a7569d-ab4a-47d2-a06a-3066d17250ae req-7223a761-3611-4e2c-b142-4b3e14bca994 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:27.811645 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-53a7569d-ab4a-47d2-a06a-3066d17250ae req-7223a761-3611-4e2c-b142-4b3e14bca994 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 943 time: 0.0497482 Dec 09 14:55:27.863239 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-53a7569d-ab4a-47d2-a06a-3066d17250ae req-85fe6394-1423-4dea-b407-ec44fae78308 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455887 Dec 09 14:55:28.991819 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-048aa20b-5006-4fbe-ab3f-1706d9c663ad req-83382f12-4a22-4928-8bab-a1272f123709 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:28.993174 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-048aa20b-5006-4fbe-ab3f-1706d9c663ad req-83382f12-4a22-4928-8bab-a1272f123709 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 943 time: 0.0494106 Dec 09 14:55:29.043164 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-048aa20b-5006-4fbe-ab3f-1706d9c663ad req-041ba46d-f29d-475a-b9e3-c5a5ee87967c tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434844 Dec 09 14:55:29.187994 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-19916ae3-9a21-437f-b6ac-34f2f553ad15 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:30.170592 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37a7743f-ad0c-4c4a-a2fd-57cfdb927661 req-0f36b47b-245e-4397-a1d9-54e768955383 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:30.172121 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-37a7743f-ad0c-4c4a-a2fd-57cfdb927661 req-0f36b47b-245e-4397-a1d9-54e768955383 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 943 time: 0.0498114 Dec 09 14:55:30.223130 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-37a7743f-ad0c-4c4a-a2fd-57cfdb927661 req-d53f499e-1676-4e0e-a701-7129dddb1cb6 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420594 Dec 09 14:55:30.490720 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:30.922971 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 0ab04229-2972-425f-b569-020d6d04388d details requested by agent hyperv_hv-cinder-81969 with host hv-cinder-81969 {{(pid=109063) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Dec 09 14:55:31.026261 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 0ab04229-2972-425f-b569-020d6d04388d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0ab04229-2972-425f-b569-020d6d04388d,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:55:31.037544 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Returning: {'device': '0ab04229-2972-425f-b569-020d6d04388d', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'port_id': '0ab04229-2972-425f-b569-020d6d04388d', 'mac_address': 'fa:16:3e:5c:3a:35', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 400, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=109063) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Dec 09 14:55:31.073612 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:31.086885 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0ab04229-2972-425f-b569-020d6d04388d {{(pid=109063) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Dec 09 14:55:31.107097 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 0ab04229-2972-425f-b569-020d6d04388d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0ab04229-2972-425f-b569-020d6d04388d,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:55:31.113732 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:31.162425 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=0ab04229-2972-425f-b569-020d6d04388d,revision_number=4']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:55:31.169473 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:31.169801 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:31.170174 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:31.170514 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:31.170846 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:31.171170 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:31.171559 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:31.171919 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:31.172247 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:31.172570 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:31.172912 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:31.173293 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:31.173551 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109063) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:31.337627 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] get_ports_and_sgs() called for port_ids ['0ab04229-2972-425f-b569-020d6d04388d'] {{(pid=109063) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Dec 09 14:55:31.630849 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc73b185-49a7-4490-a409-4c94985b68d5 req-6881317d-3b0a-4435-b318-03cee7952c3d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:31.632492 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bc73b185-49a7-4490-a409-4c94985b68d5 req-6881317d-3b0a-4435-b318-03cee7952c3d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 944 time: 0.3328104 Dec 09 14:55:31.684300 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bc73b185-49a7-4490-a409-4c94985b68d5 req-ee9dcfaa-8dea-4be8-a9b9-d493883341cc tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454769 Dec 09 14:55:31.862181 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:32.616341 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:32.822979 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c917b4b-7fc2-404d-a93e-23325e90a73d req-56cc4050-403a-499b-953e-7756ece4c7e4 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:32.824474 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0c917b4b-7fc2-404d-a93e-23325e90a73d req-56cc4050-403a-499b-953e-7756ece4c7e4 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 944 time: 0.0603378 Dec 09 14:55:32.875726 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-0c917b4b-7fc2-404d-a93e-23325e90a73d req-7d31ace2-d9f2-4f6b-921d-70c685e18db6 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423796 Dec 09 14:55:32.940593 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 0ab04229-2972-425f-b569-020d6d04388d up at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Dec 09 14:55:33.001668 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning for port 0ab04229-2972-425f-b569-020d6d04388d completed by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Dec 09 14:55:33.005216 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.provisioning_blocks [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Provisioning complete for port 0ab04229-2972-425f-b569-020d6d04388d triggered by entity L2. {{(pid=109063) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Dec 09 14:55:33.005590 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-925220'] for port, provisioning_complete {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:33.086207 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:33.109444 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ab04229-2972-425f-b569-020d6d04388d'}] {{(pid=109063) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:55:33.111754 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2deb810a067ad5119b30179ac0cf1073ca7d1fd64a61ace2bec453901619ff54" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-92c2e845-5c56-49bd-9502-3b9f6bde6763" -d '{"events": [{"server_uuid": "6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab", "name": "network-vif-plugged", "status": "completed", "tag": "0ab04229-2972-425f-b569-020d6d04388d"}]}' {{(pid=109063) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:55:33.125634 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.db [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] For port 0ab04229-2972-425f-b569-020d6d04388d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0ab04229-2972-425f-b569-020d6d04388d,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109063) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:55:33.131264 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986'] for port, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:33.153592 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:55:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4de6667e-d203-4532-9135-69f7340b4a5f x-openstack-request-id: req-4de6667e-d203-4532-9135-69f7340b4a5f {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:55:33.153885 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab", "name": "network-vif-plugged", "status": "completed", "tag": "0ab04229-2972-425f-b569-020d6d04388d", "code": 200}]} {{(pid=109063) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:55:33.154136 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-4de6667e-d203-4532-9135-69f7340b4a5f {{(pid=109063) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:55:33.154532 dv-cinder-819692-8-iscsi neutron-server[109063]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0ab04229-2972-425f-b569-020d6d04388d', 'code': 200} Dec 09 14:55:33.179654 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Pushing event updated for resources: {'Port': ['ID=0ab04229-2972-425f-b569-020d6d04388d,revision_number=5']} {{(pid=109063) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:55:33.391796 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5126c01-97b3-43f8-b6f1-1d753f0aec82 req-f0a7f701-3af4-4a03-b9c1-e46da795873a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:33.393203 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f5126c01-97b3-43f8-b6f1-1d753f0aec82 req-f0a7f701-3af4-4a03-b9c1-e46da795873a service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 1098 time: 0.0426385 Dec 09 14:55:33.440072 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f5126c01-97b3-43f8-b6f1-1d753f0aec82 req-2107956e-ac94-4626-84fe-8f818a41c8c2 service neutron] 10.222.0.44 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0391901 Dec 09 14:55:34.023355 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1db2879a-0482-4fc7-92e9-04eef5f8adac req-d8031e5e-2384-4413-a4f0-b4b22f3f70d0 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:34.024858 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1db2879a-0482-4fc7-92e9-04eef5f8adac req-d8031e5e-2384-4413-a4f0-b4b22f3f70d0 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 945 time: 0.0616074 Dec 09 14:55:34.075741 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-1db2879a-0482-4fc7-92e9-04eef5f8adac req-64099395-6306-45a1-b402-76523860454b tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447361 Dec 09 14:55:35.208551 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6982d00-ccd7-4d4b-b0c4-72117f289805 req-949bb492-4776-4b19-bf06-580daf993f96 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:35.209990 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f6982d00-ccd7-4d4b-b0c4-72117f289805 req-949bb492-4776-4b19-bf06-580daf993f96 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 945 time: 0.0541582 Dec 09 14:55:35.261726 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f6982d00-ccd7-4d4b-b0c4-72117f289805 req-7af9e74b-1b39-441b-b12d-d2afe587010f tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427775 Dec 09 14:55:35.377726 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0a90466-13fc-4167-b1d5-64f1c239da5b req-01cf5905-9ca8-4887-beb6-72ae008929f7 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:35.379072 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b0a90466-13fc-4167-b1d5-64f1c239da5b req-01cf5905-9ca8-4887-beb6-72ae008929f7 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 945 time: 0.0502565 Dec 09 14:55:35.431740 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-b0a90466-13fc-4167-b1d5-64f1c239da5b req-26c8f683-f647-4f0d-8ddd-ab531d13e2ca tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436795 Dec 09 14:55:35.453810 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34672) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:55:35.498773 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-592b4bb0-406f-4d60-ad58-e31f14ef2f10 tempest-TestVolumeBootPattern-769977608 tempest-TestVolumeBootPattern-769977608-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:35.500285 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-592b4bb0-406f-4d60-ad58-e31f14ef2f10 tempest-TestVolumeBootPattern-769977608 tempest-TestVolumeBootPattern-769977608-project-admin] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 1093 time: 0.0454857 Dec 09 14:55:35.504314 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34674) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:55:35.508604 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.v2.base [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Request body: {'floatingip': {'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'port_id': '0ab04229-2972-425f-b569-020d6d04388d', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address': '172.20.0.5'}} {{(pid=109062) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Dec 09 14:55:35.534279 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for floatingip, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:35.633946 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:35.739541 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_common [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Allocated IP 172.27.0.27 (ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c/e694bbf8-2176-4a1d-9b13-4712a7fb8309/9820ce90-1938-4c53-955d-34713a59954b) {{(pid=109062) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Dec 09 14:55:35.841390 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for port, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:35.877401 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8747842492950', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:35.913071 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Network ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c is already hosted by enough agents. {{(pid=109062) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Dec 09 14:55:35.917599 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.base_scheduler [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Resources bound (agent type, host, resource id): {{(pid=109062) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Dec 09 14:55:35.920317 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Received port after_create {{(pid=109062) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Dec 09 14:55:35.946155 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'Port': ['ID=9820ce90-1938-4c53-955d-34713a59954b,revision_number=1']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:55:35.957044 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:35.957390 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:35.957732 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:35.958068 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:35.958397 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:35.958720 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:35.959044 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:35.959372 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:35.959726 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:35.960054 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:35.960377 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:35.960714 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:35.961026 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:55:36.307387 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for floatingip, precommit_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:36.378167 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-914809'] for port, before_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:36.536089 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for port, precommit_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:36.544250 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8747843042097', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8747842492968', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8747842492986', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-130461426'] for port, after_update {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:36.610368 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event updated for resources: {'Port': ['ID=9820ce90-1938-4c53-955d-34713a59954b,revision_number=2']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:55:36.624181 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1574237'] for floatingip, after_create {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:36.726532 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.l3_db [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Floating IP 119fe495-56c8-4d7a-8870-709ebbf2898a associated. External IP: 172.27.0.27, port: 0ab04229-2972-425f-b569-020d6d04388d. Dec 09 14:55:36.928460 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Router 0afa8c36-934f-4ee2-8457-fb4e00214c4d has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:55:37.031252 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:55:37.041118 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7d96a9a-16ee-4e9e-b4ca-a49743295f2e None None] Sync routers for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:55:37.050713 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:37.051406 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7d96a9a-16ee-4e9e-b4ca-a49743295f2e None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:55:37.052073 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-a7d96a9a-16ee-4e9e-b4ca-a49743295f2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:55:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:55:37.078624 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-b5f1fbb9-853c-42c2-ba5a-6312e2970a55 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 1.5732915 Dec 09 14:55:37.079236 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab', 'tag': '0ab04229-2972-425f-b569-020d6d04388d'}] {{(pid=109062) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:55:37.081635 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3f1ec408b0eec5a36b56e0a757eff0f4875d9a95eff62f4d0b4a62bb27a3b600" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-409b5274-89d6-4684-adce-7dd315d1b570" -d '{"events": [{"name": "network-changed", "server_uuid": "6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab", "tag": "0ab04229-2972-425f-b569-020d6d04388d"}]}' {{(pid=109062) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:55:37.159438 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-a7d96a9a-16ee-4e9e-b4ca-a49743295f2e None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:55:37.227293 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:55:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-46006a79-8fa8-4df5-a234-ecaaeab85282 x-openstack-request-id: req-46006a79-8fa8-4df5-a234-ecaaeab85282 {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:55:37.227571 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab", "tag": "0ab04229-2972-425f-b569-020d6d04388d", "status": "completed", "code": 200}]} {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:55:37.227873 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-46006a79-8fa8-4df5-a234-ecaaeab85282 {{(pid=109062) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:55:37.228314 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab', 'tag': '0ab04229-2972-425f-b569-020d6d04388d', 'status': 'completed', 'code': 200} Dec 09 14:55:37.289874 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-409b5274-89d6-4684-adce-7dd315d1b570 req-b72dbf94-aff1-4483-9943-ede94ddecb3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:37.291383 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-409b5274-89d6-4684-adce-7dd315d1b570 req-b72dbf94-aff1-4483-9943-ede94ddecb3e service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 1098 time: 0.0401826 Dec 09 14:55:37.380369 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-a7d96a9a-16ee-4e9e-b4ca-a49743295f2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '119fe495-56c8-4d7a-8870-709ebbf2898a', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'floating_ip_address': '172.27.0.27', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'port_id': '0ab04229-2972-425f-b569-020d6d04388d', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'mac_address': 'fa:16:3e:5c:3a:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:55:36Z', 'updated_at': '2021-12-09T14:55:36Z', 'revision_number': 0, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address_scope': None}, {'id': '503721b7-6546-41f1-a3cc-46b507f13a1e', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'floating_ip_address': '172.27.0.248', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'port_id': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'mac_address': 'fa:16:3e:54:41:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81780f80-b704-4238-a626-320bce1e01af', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:53:39Z', 'updated_at': '2021-12-09T14:53:41Z', 'revision_number': 1, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:55:37.385740 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-409b5274-89d6-4684-adce-7dd315d1b570 req-e9b42d15-5220-4a3d-9615-1eb08aa7a956 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:37.387236 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-409b5274-89d6-4684-adce-7dd315d1b570 req-e9b42d15-5220-4a3d-9615-1eb08aa7a956 service neutron] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 913 time: 0.0874660 Dec 09 14:55:37.409766 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7d96a9a-16ee-4e9e-b4ca-a49743295f2e None None] Checking router: 0afa8c36-934f-4ee2-8457-fb4e00214c4d for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:55:37.418478 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a7d96a9a-16ee-4e9e-b4ca-a49743295f2e None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:55:37.419086 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-a7d96a9a-16ee-4e9e-b4ca-a49743295f2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:55:29Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:55:37.452386 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-409b5274-89d6-4684-adce-7dd315d1b570 req-b4b44311-16f5-421a-9058-8bf634e56d6b service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0ab04229-2972-425f-b569-020d6d04388d HTTP/1.1" status: 200 len: 998 time: 0.0578270 Dec 09 14:55:37.502270 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-409b5274-89d6-4684-adce-7dd315d1b570 req-989168d8-2f3e-4616-976e-cc75780fa701 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:37.503768 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-409b5274-89d6-4684-adce-7dd315d1b570 req-989168d8-2f3e-4616-976e-cc75780fa701 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0448332 Dec 09 14:55:37.520914 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-a7d96a9a-16ee-4e9e-b4ca-a49743295f2e None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:55:37.558305 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-409b5274-89d6-4684-adce-7dd315d1b570 req-b978bc77-ae85-4a06-bb84-5e0258acab60 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:37.559809 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-409b5274-89d6-4684-adce-7dd315d1b570 req-b978bc77-ae85-4a06-bb84-5e0258acab60 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0476582 Dec 09 14:55:37.648909 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-409b5274-89d6-4684-adce-7dd315d1b570 req-0006db3d-ad20-4ce8-8d11-cffbcaf66aea service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0814877 Dec 09 14:55:37.746642 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-a7d96a9a-16ee-4e9e-b4ca-a49743295f2e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '119fe495-56c8-4d7a-8870-709ebbf2898a', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'floating_ip_address': '172.27.0.27', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'port_id': '0ab04229-2972-425f-b569-020d6d04388d', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'mac_address': 'fa:16:3e:5c:3a:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:55:36Z', 'updated_at': '2021-12-09T14:55:36Z', 'revision_number': 0, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address_scope': None}, {'id': '503721b7-6546-41f1-a3cc-46b507f13a1e', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'floating_ip_address': '172.27.0.248', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'port_id': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'mac_address': 'fa:16:3e:54:41:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81780f80-b704-4238-a626-320bce1e01af', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:53:39Z', 'updated_at': '2021-12-09T14:53:41Z', 'revision_number': 1, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:55:37.748353 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-409b5274-89d6-4684-adce-7dd315d1b570 req-d4e90bfa-1ea7-4be6-9483-67a27719a448 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0914800 Dec 09 14:55:37.772624 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a7d96a9a-16ee-4e9e-b4ca-a49743295f2e None None] The sync data for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi is: [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '119fe495-56c8-4d7a-8870-709ebbf2898a', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'floating_ip_address': '172.27.0.27', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'port_id': '0ab04229-2972-425f-b569-020d6d04388d', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'mac_address': 'fa:16:3e:5c:3a:35', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:55:36Z', 'updated_at': '2021-12-09T14:55:36Z', 'revision_number': 0, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address_scope': None}, {'id': '503721b7-6546-41f1-a3cc-46b507f13a1e', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'floating_ip_address': '172.27.0.248', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'port_id': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'mac_address': 'fa:16:3e:54:41:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81780f80-b704-4238-a626-320bce1e01af', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:53:39Z', 'updated_at': '2021-12-09T14:53:41Z', 'revision_number': 1, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:55:37.965167 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c8a5ae1-6de3-46cd-9861-d2f7ee38b9fe None None] New status for floating IP 119fe495-56c8-4d7a-8870-709ebbf2898a: ACTIVE {{(pid=109064) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:55:44.926142 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:46.481161 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:55:52.112734 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-418d4a2e-9245-4c63-8be9-2767481692c1 req-0df11a7d-725b-4d5d-b3d6-29fb1d241e78 service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0415187 Dec 09 14:55:52.210821 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-418d4a2e-9245-4c63-8be9-2767481692c1 req-bf036955-529d-4194-be87-11bf3c899cbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:52.212431 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-418d4a2e-9245-4c63-8be9-2767481692c1 req-bf036955-529d-4194-be87-11bf3c899cbd service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 1099 time: 0.0504153 Dec 09 14:55:52.316699 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-418d4a2e-9245-4c63-8be9-2767481692c1 req-27b91e47-645c-457f-8fec-102b3d4b0f65 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:52.318113 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-418d4a2e-9245-4c63-8be9-2767481692c1 req-27b91e47-645c-457f-8fec-102b3d4b0f65 service neutron] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 913 time: 0.0856845 Dec 09 14:55:52.386030 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-418d4a2e-9245-4c63-8be9-2767481692c1 req-37a0ed9f-b9f2-4e68-b349-3e8a42a277ee service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=65be3d81-a35f-4fa9-a69a-59deb88c6a80 HTTP/1.1" status: 200 len: 1002 time: 0.0579610 Dec 09 14:55:52.438669 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-418d4a2e-9245-4c63-8be9-2767481692c1 req-80aff07b-27af-44e5-a3d8-390f8bde49f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:52.440129 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-418d4a2e-9245-4c63-8be9-2767481692c1 req-80aff07b-27af-44e5-a3d8-390f8bde49f7 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0423155 Dec 09 14:55:52.491452 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-418d4a2e-9245-4c63-8be9-2767481692c1 req-44eaa35b-d2c2-47f5-9985-3edbd1fe6a3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:55:52.493002 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-418d4a2e-9245-4c63-8be9-2767481692c1 req-44eaa35b-d2c2-47f5-9985-3edbd1fe6a3c service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0455332 Dec 09 14:55:52.600546 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-418d4a2e-9245-4c63-8be9-2767481692c1 req-8b784cbc-759b-4b6b-b276-7c4d5f421b01 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0943003 Dec 09 14:55:52.695385 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-418d4a2e-9245-4c63-8be9-2767481692c1 req-9f6a88f5-b6bf-4a9e-b1b3-f3be164719d7 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0869780 Dec 09 14:55:57.044034 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-7405b70f-e6c1-42e1-977f-d043c06cadef None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:55:59.190588 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-0e1bd47f-c473-4d60-b018-db75d8cf5627 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:56:00.496196 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:56:01.858046 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:56:02.622339 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:56:14.949981 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:56:23.486838 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:56:27.049478 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-085ce37c-0661-44e9-97e6-e0192d371d72 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:56:29.196651 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-ce3e7e6d-5905-4c93-8029-78740116684d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:56:30.491782 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:56:31.860436 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:56:32.616778 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:56:44.949246 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:56:54.128260 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de82701a-68e0-4d06-b721-846db6c4a178 req-71b65e4e-0b0f-4b82-a3cf-d75dcd17f5ae service neutron] 10.222.0.44 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0489881 Dec 09 14:56:54.200978 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de82701a-68e0-4d06-b721-846db6c4a178 req-c04efb83-92ea-467d-b29c-addf7e1b027c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:56:54.202473 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de82701a-68e0-4d06-b721-846db6c4a178 req-c04efb83-92ea-467d-b29c-addf7e1b027c service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 1098 time: 0.0439026 Dec 09 14:56:54.317695 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de82701a-68e0-4d06-b721-846db6c4a178 req-023befdd-42bf-40de-8c73-4397aa066dc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:56:54.319201 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de82701a-68e0-4d06-b721-846db6c4a178 req-023befdd-42bf-40de-8c73-4397aa066dc7 service neutron] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 913 time: 0.0930629 Dec 09 14:56:54.385649 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de82701a-68e0-4d06-b721-846db6c4a178 req-1dd09786-bcb7-4e7b-88f1-2267180aa21f service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0ab04229-2972-425f-b569-020d6d04388d HTTP/1.1" status: 200 len: 1000 time: 0.0588791 Dec 09 14:56:54.434650 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de82701a-68e0-4d06-b721-846db6c4a178 req-6c92a51e-5683-4c1d-b579-460623fef81d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:56:54.436021 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de82701a-68e0-4d06-b721-846db6c4a178 req-6c92a51e-5683-4c1d-b579-460623fef81d service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0431120 Dec 09 14:56:54.484345 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de82701a-68e0-4d06-b721-846db6c4a178 req-48c1b2c4-822d-4eeb-b053-e73cd6148439 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:56:54.485788 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de82701a-68e0-4d06-b721-846db6c4a178 req-48c1b2c4-822d-4eeb-b053-e73cd6148439 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0421603 Dec 09 14:56:54.586878 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de82701a-68e0-4d06-b721-846db6c4a178 req-fe602387-c943-4238-9626-761a4c01d3b8 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0921524 Dec 09 14:56:54.684783 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-de82701a-68e0-4d06-b721-846db6c4a178 req-e90acf42-f8b3-4eeb-9555-2ace580f4fd0 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0904126 Dec 09 14:56:57.044666 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-695ccbe6-1d63-4718-b258-9014a2714cf4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:56:59.189330 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-15e4325e-479d-437d-bd7d-17ba84492700 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:00.493681 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:57:00.501308 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:01.873457 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:02.623332 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:06.192944 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34718) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:06.413073 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Deleting port 9820ce90-1938-4c53-955d-34713a59954b {{(pid=109062) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:57:06.413391 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:06.485017 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:06.485239 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:06.497233 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Calling delete_port for 9820ce90-1938-4c53-955d-34713a59954b owned by network:floatingip {{(pid=109062) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:57:06.646810 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:06.670633 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event deleted for resources: {'Port': ['ID=9820ce90-1938-4c53-955d-34713a59954b,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:06.681713 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:06.682055 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:06.682396 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:06.682731 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:06.683059 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:06.683383 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:06.683740 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:06.684067 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:06.684393 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:06.684712 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:06.685034 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:06.685355 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:06.685671 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109062) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:06.740653 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for floatingip, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:06.740892 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.l3_db [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Floating IP 119fe495-56c8-4d7a-8870-709ebbf2898a disassociated (deleted). External IP: 172.27.0.27, port: 0ab04229-2972-425f-b569-020d6d04388d. Dec 09 14:57:07.216762 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Router 0afa8c36-934f-4ee2-8457-fb4e00214c4d has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:57:07.328105 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:57:07.332512 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:07.338169 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8ba6296-f0b5-452a-8317-56565f3c8f3f None None] Sync routers for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:57:07.348862 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8ba6296-f0b5-452a-8317-56565f3c8f3f None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:57:07.349507 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-d8ba6296-f0b5-452a-8317-56565f3c8f3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:56:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:07.361647 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-2e48468f-9f00-47ac-831f-d9fdc664723e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "DELETE /v2.0/floatingips/119fe495-56c8-4d7a-8870-709ebbf2898a HTTP/1.1" status: 204 len: 168 time: 1.1648028 Dec 09 14:57:07.361647 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab', 'tag': '0ab04229-2972-425f-b569-020d6d04388d'}] {{(pid=109062) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:57:07.362069 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3f1ec408b0eec5a36b56e0a757eff0f4875d9a95eff62f4d0b4a62bb27a3b600" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd1bb778-63de-4262-bc7d-511946e8bc09" -d '{"events": [{"name": "network-changed", "server_uuid": "6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab", "tag": "0ab04229-2972-425f-b569-020d6d04388d"}]}' {{(pid=109062) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:57:07.399732 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:57:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-58c86dd1-4871-4cb6-9e17-945db54d0ff2 x-openstack-request-id: req-58c86dd1-4871-4cb6-9e17-945db54d0ff2 {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:57:07.400708 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab", "tag": "0ab04229-2972-425f-b569-020d6d04388d", "status": "completed", "code": 200}]} {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:57:07.400971 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-58c86dd1-4871-4cb6-9e17-945db54d0ff2 {{(pid=109062) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:57:07.401409 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab', 'tag': '0ab04229-2972-425f-b569-020d6d04388d', 'status': 'completed', 'code': 200} Dec 09 14:57:07.456408 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-d8ba6296-f0b5-452a-8317-56565f3c8f3f None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:57:07.466497 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1bb778-63de-4262-bc7d-511946e8bc09 req-01cdc9b8-42d7-4533-a4d9-cb11a0f1fa17 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:57:07.468004 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-dd1bb778-63de-4262-bc7d-511946e8bc09 req-01cdc9b8-42d7-4533-a4d9-cb11a0f1fa17 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 1098 time: 0.0446079 Dec 09 14:57:07.590485 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1bb778-63de-4262-bc7d-511946e8bc09 req-78a523de-edcd-4265-b752-e355cd915a77 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:57:07.591998 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-dd1bb778-63de-4262-bc7d-511946e8bc09 req-78a523de-edcd-4265-b752-e355cd915a77 service neutron] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 913 time: 0.1140871 Dec 09 14:57:07.615986 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-671d4db3-fd13-4ae4-905a-c113dd6a4700 req-47f87d00-bba8-4e71-a5f8-33646006ae65 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:57:07.617434 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-671d4db3-fd13-4ae4-905a-c113dd6a4700 req-47f87d00-bba8-4e71-a5f8-33646006ae65 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 945 time: 0.0704062 Dec 09 14:57:07.651337 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-dd1bb778-63de-4262-bc7d-511946e8bc09 req-f893aa06-1eb5-4705-b267-43078580f834 service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=0ab04229-2972-425f-b569-020d6d04388d HTTP/1.1" status: 200 len: 217 time: 0.0514836 Dec 09 14:57:07.693767 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-d8ba6296-f0b5-452a-8317-56565f3c8f3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '503721b7-6546-41f1-a3cc-46b507f13a1e', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'floating_ip_address': '172.27.0.248', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'port_id': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'mac_address': 'fa:16:3e:54:41:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81780f80-b704-4238-a626-320bce1e01af', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:53:39Z', 'updated_at': '2021-12-09T14:53:41Z', 'revision_number': 1, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:07.719237 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8ba6296-f0b5-452a-8317-56565f3c8f3f None None] Checking router: 0afa8c36-934f-4ee2-8457-fb4e00214c4d for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:57:07.720512 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-671d4db3-fd13-4ae4-905a-c113dd6a4700 req-b778b9c2-b2b4-4b89-8594-936c0ef1846e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0767972 Dec 09 14:57:07.724362 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1bb778-63de-4262-bc7d-511946e8bc09 req-d7b7c967-f131-40cd-a223-ac9f37255c58 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:57:07.725769 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-dd1bb778-63de-4262-bc7d-511946e8bc09 req-d7b7c967-f131-40cd-a223-ac9f37255c58 service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0660050 Dec 09 14:57:07.727782 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8ba6296-f0b5-452a-8317-56565f3c8f3f None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:57:07.728446 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-d8ba6296-f0b5-452a-8317-56565f3c8f3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:56:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:07.779084 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd1bb778-63de-4262-bc7d-511946e8bc09 req-1fb058aa-e4e6-4c2b-a22b-81c80e250ec8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:57:07.780624 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-dd1bb778-63de-4262-bc7d-511946e8bc09 req-1fb058aa-e4e6-4c2b-a22b-81c80e250ec8 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0445065 Dec 09 14:57:07.834024 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-d8ba6296-f0b5-452a-8317-56565f3c8f3f None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:57:07.872206 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-dd1bb778-63de-4262-bc7d-511946e8bc09 req-7ff89b1f-079e-4ac5-88ea-8db7045d8aaa service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816002 Dec 09 14:57:07.967357 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-dd1bb778-63de-4262-bc7d-511946e8bc09 req-b5176fa5-6e2a-4864-b227-ad94b6e30c06 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874710 Dec 09 14:57:08.194268 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-d8ba6296-f0b5-452a-8317-56565f3c8f3f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '503721b7-6546-41f1-a3cc-46b507f13a1e', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'floating_ip_address': '172.27.0.248', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'port_id': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'mac_address': 'fa:16:3e:54:41:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81780f80-b704-4238-a626-320bce1e01af', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:53:39Z', 'updated_at': '2021-12-09T14:53:41Z', 'revision_number': 1, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:08.220194 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d8ba6296-f0b5-452a-8317-56565f3c8f3f None None] The sync data for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi is: [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_floatingips': [{'id': '503721b7-6546-41f1-a3cc-46b507f13a1e', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'floating_ip_address': '172.27.0.248', 'floating_network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'router_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'port_id': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'mac_address': 'fa:16:3e:54:41:ca', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '81780f80-b704-4238-a626-320bce1e01af', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-12-09T14:53:39Z', 'updated_at': '2021-12-09T14:53:41Z', 'revision_number': 1, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:57:08.468121 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-159aa6fe-edd9-47cb-8f9b-a56a0bd8ec32 None None] New status for floating IP 119fe495-56c8-4d7a-8870-709ebbf2898a: DOWN {{(pid=109064) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:57:08.852763 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81e6342c-ff67-4f5d-971c-0a7ece8a9375 req-0c983f70-5ec6-4b8c-8dd7-014d9fae4bc8 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:57:08.854263 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-81e6342c-ff67-4f5d-971c-0a7ece8a9375 req-0c983f70-5ec6-4b8c-8dd7-014d9fae4bc8 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 945 time: 0.0526946 Dec 09 14:57:08.908607 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-81e6342c-ff67-4f5d-971c-0a7ece8a9375 req-0ce96299-deb8-4b4d-ae15-61861a81e16a tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457001 Dec 09 14:57:09.139120 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea90a0a2-4d39-473a-bebf-2fe13569c662 req-97eebec6-7639-4b07-8726-ebf0625db43d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:57:09.140613 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ea90a0a2-4d39-473a-bebf-2fe13569c662 req-97eebec6-7639-4b07-8726-ebf0625db43d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.44 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 945 time: 0.0586925 Dec 09 14:57:09.232194 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-ea90a0a2-4d39-473a-bebf-2fe13569c662 req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Deleting port 0ab04229-2972-425f-b569-020d6d04388d {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:57:09.232541 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-ea90a0a2-4d39-473a-bebf-2fe13569c662 req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:09.335953 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-ea90a0a2-4d39-473a-bebf-2fe13569c662 req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] For port 0ab04229-2972-425f-b569-020d6d04388d, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=0ab04229-2972-425f-b569-020d6d04388d,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:57:09.336284 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-ea90a0a2-4d39-473a-bebf-2fe13569c662 req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:09.349289 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-ea90a0a2-4d39-473a-bebf-2fe13569c662 req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Calling delete_port for 0ab04229-2972-425f-b569-020d6d04388d owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:57:09.491760 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-ea90a0a2-4d39-473a-bebf-2fe13569c662 req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:09.521390 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event deleted for resources: {'Port': ['ID=0ab04229-2972-425f-b569-020d6d04388d,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:09.546581 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:09.546934 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:09.547280 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:09.547636 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:09.547976 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:09.548305 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:09.548632 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:09.548955 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:09.549283 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:09.549603 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:09.549924 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:09.550241 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:09.550558 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-819692-8-iscsi {{(pid=109061) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Dec 09 14:57:09.569004 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-ea90a0a2-4d39-473a-bebf-2fe13569c662 req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] No DVR routers for this DVR port 0ab04229-2972-425f-b569-020d6d04388d on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:57:09.571329 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-ea90a0a2-4d39-473a-bebf-2fe13569c662 req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:09.574609 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-ea90a0a2-4d39-473a-bebf-2fe13569c662 req-1533253b-8045-44ff-95bb-e0516eefdd42 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.44 "DELETE /v2.0/ports/0ab04229-2972-425f-b569-020d6d04388d HTTP/1.1" status: 204 len: 173 time: 0.4276154 Dec 09 14:57:09.575046 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab', 'name': 'network-vif-deleted', 'tag': '0ab04229-2972-425f-b569-020d6d04388d'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:57:09.577378 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-728957ad-4016-47ec-9d4b-388ca34c58f1" -d '{"events": [{"server_uuid": "6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab", "name": "network-vif-deleted", "tag": "0ab04229-2972-425f-b569-020d6d04388d"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:57:09.613558 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:57:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3753f271-b623-4758-b9e6-e8696fec4676 x-openstack-request-id: req-3753f271-b623-4758-b9e6-e8696fec4676 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:57:09.613848 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab", "name": "network-vif-deleted", "tag": "0ab04229-2972-425f-b569-020d6d04388d", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:57:09.614102 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-3753f271-b623-4758-b9e6-e8696fec4676 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:57:09.614505 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab', 'name': 'network-vif-deleted', 'tag': '0ab04229-2972-425f-b569-020d6d04388d', 'status': 'completed', 'code': 200} Dec 09 14:57:10.023560 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-c7073b3d-5515-43a9-ba09-6956dd1efc30 req-bd12049b-790e-4a1b-85a6-a60c882bce1e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=6ff7e37d-4d23-4bc4-9054-e4bd9ed41aab HTTP/1.1" status: 200 len: 210 time: 0.0252855 Dec 09 14:57:13.334703 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34758) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:13.382355 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 0ab04229-2972-425f-b569-020d6d04388d no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:57:13.405183 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: 0ab04229-2972-425f-b569-020d6d04388d {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:57:13.405523 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 0ab04229-2972-425f-b569-020d6d04388d not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:57:13.500418 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-bb8649ea-227d-4729-9640-057d0adb4064 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Deleting port 0f6c05f1-e085-4935-b84a-8f1c5f6c7793 {{(pid=109062) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:57:13.500817 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-bb8649ea-227d-4729-9640-057d0adb4064 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:13.573114 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-bb8649ea-227d-4729-9640-057d0adb4064 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:13.573389 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-bb8649ea-227d-4729-9640-057d0adb4064 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:13.584970 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-bb8649ea-227d-4729-9640-057d0adb4064 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Calling delete_port for 0f6c05f1-e085-4935-b84a-8f1c5f6c7793 owned by network:floatingip {{(pid=109062) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:57:13.740097 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-bb8649ea-227d-4729-9640-057d0adb4064 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:13.764584 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb8649ea-227d-4729-9640-057d0adb4064 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event deleted for resources: {'Port': ['ID=0f6c05f1-e085-4935-b84a-8f1c5f6c7793,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:13.824941 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-bb8649ea-227d-4729-9640-057d0adb4064 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for floatingip, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:13.825189 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.db.l3_db [None req-bb8649ea-227d-4729-9640-057d0adb4064 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Floating IP 503721b7-6546-41f1-a3cc-46b507f13a1e disassociated (deleted). External IP: 172.27.0.248, port: 65be3d81-a35f-4fa9-a69a-59deb88c6a80. Dec 09 14:57:14.021217 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bb8649ea-227d-4729-9640-057d0adb4064 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Router 0afa8c36-934f-4ee2-8457-fb4e00214c4d has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109062) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:57:14.129962 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bb8649ea-227d-4729-9640-057d0adb4064 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109062) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:57:14.134882 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-bb8649ea-227d-4729-9640-057d0adb4064 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:14.141156 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e96141b0-319f-4f98-a6da-f5e59ff70339 None None] Sync routers for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:57:14.149947 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e96141b0-319f-4f98-a6da-f5e59ff70339 None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:57:14.150553 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-e96141b0-319f-4f98-a6da-f5e59ff70339 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:56:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:14.163377 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-bb8649ea-227d-4729-9640-057d0adb4064 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "DELETE /v2.0/floatingips/503721b7-6546-41f1-a3cc-46b507f13a1e HTTP/1.1" status: 204 len: 168 time: 0.8247507 Dec 09 14:57:14.163377 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '81780f80-b704-4238-a626-320bce1e01af', 'tag': '65be3d81-a35f-4fa9-a69a-59deb88c6a80'}] {{(pid=109062) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:57:14.163792 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}3f1ec408b0eec5a36b56e0a757eff0f4875d9a95eff62f4d0b4a62bb27a3b600" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f4b0b3e2-4daa-4689-9a3e-f5164f88bb5a" -d '{"events": [{"name": "network-changed", "server_uuid": "81780f80-b704-4238-a626-320bce1e01af", "tag": "65be3d81-a35f-4fa9-a69a-59deb88c6a80"}]}' {{(pid=109062) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:57:14.200169 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 09 Dec 2021 14:57:14 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6356dafa-244b-4fbb-9a1e-f92a72da28e3 x-openstack-request-id: req-6356dafa-244b-4fbb-9a1e-f92a72da28e3 {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:57:14.200470 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "81780f80-b704-4238-a626-320bce1e01af", "tag": "65be3d81-a35f-4fa9-a69a-59deb88c6a80", "status": "completed", "code": 200}]} {{(pid=109062) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:57:14.200729 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-6356dafa-244b-4fbb-9a1e-f92a72da28e3 {{(pid=109062) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:57:14.201136 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '81780f80-b704-4238-a626-320bce1e01af', 'tag': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'status': 'completed', 'code': 200} Dec 09 14:57:14.257054 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-e96141b0-319f-4f98-a6da-f5e59ff70339 None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:57:14.270704 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b0b3e2-4daa-4689-9a3e-f5164f88bb5a req-2d6c45e6-c517-4d4b-92ae-1123917d1954 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:57:14.273226 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f4b0b3e2-4daa-4689-9a3e-f5164f88bb5a req-2d6c45e6-c517-4d4b-92ae-1123917d1954 service neutron] 10.222.0.44 "GET /v2.0/ports?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 1099 time: 0.0488491 Dec 09 14:57:14.401667 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b0b3e2-4daa-4689-9a3e-f5164f88bb5a req-011b6f82-8f5e-4084-a92b-69b05d872bb5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:57:14.403013 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f4b0b3e2-4daa-4689-9a3e-f5164f88bb5a req-011b6f82-8f5e-4084-a92b-69b05d872bb5 service neutron] 10.222.0.44 "GET /v2.0/networks?id=245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 200 len: 913 time: 0.1192284 Dec 09 14:57:14.415146 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc6dc227-5eeb-496e-926d-41147baef5ab req-e83f0163-adcc-4b55-ab82-1294cb5d717b tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:57:14.416576 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bc6dc227-5eeb-496e-926d-41147baef5ab req-e83f0163-adcc-4b55-ab82-1294cb5d717b tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 946 time: 0.0720766 Dec 09 14:57:14.457272 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-e96141b0-319f-4f98-a6da-f5e59ff70339 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:14.464150 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f4b0b3e2-4daa-4689-9a3e-f5164f88bb5a req-5277403f-a0a0-4164-8058-0b47328d92da service neutron] 10.222.0.44 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=65be3d81-a35f-4fa9-a69a-59deb88c6a80 HTTP/1.1" status: 200 len: 217 time: 0.0464957 Dec 09 14:57:14.483141 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e96141b0-319f-4f98-a6da-f5e59ff70339 None None] Checking router: 0afa8c36-934f-4ee2-8457-fb4e00214c4d for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:57:14.492096 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e96141b0-319f-4f98-a6da-f5e59ff70339 None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:57:14.492811 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-e96141b0-319f-4f98-a6da-f5e59ff70339 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:56:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:14.521539 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-bc6dc227-5eeb-496e-926d-41147baef5ab req-495d7ab2-f901-405d-b984-b61eeccdf0c7 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0973716 Dec 09 14:57:14.543737 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b0b3e2-4daa-4689-9a3e-f5164f88bb5a req-f71f16ae-1ab2-4b8f-b462-b85535f9d92b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:57:14.545231 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f4b0b3e2-4daa-4689-9a3e-f5164f88bb5a req-f71f16ae-1ab2-4b8f-b462-b85535f9d92b service neutron] 10.222.0.44 "GET /v2.0/subnets?id=548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 200 len: 851 time: 0.0737715 Dec 09 14:57:14.591376 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b0b3e2-4daa-4689-9a3e-f5164f88bb5a req-15c9ff6f-4cca-4ea1-a422-6b6d55cddb20 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:57:14.592865 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f4b0b3e2-4daa-4689-9a3e-f5164f88bb5a req-15c9ff6f-4cca-4ea1-a422-6b6d55cddb20 service neutron] 10.222.0.44 "GET /v2.0/ports?network_id=245ba82b-ada3-409a-912d-4462e3cd3ab8&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0396204 Dec 09 14:57:14.602117 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-e96141b0-319f-4f98-a6da-f5e59ff70339 None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:57:14.686934 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f4b0b3e2-4daa-4689-9a3e-f5164f88bb5a req-f25474cc-86d7-4148-a1eb-7a7c51bbbea6 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861902 Dec 09 14:57:14.776807 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-f4b0b3e2-4daa-4689-9a3e-f5164f88bb5a req-8d6eb223-d023-459b-a077-7241c2c06013 service neutron] 10.222.0.44 "GET /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0823092 Dec 09 14:57:14.803433 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-e96141b0-319f-4f98-a6da-f5e59ff70339 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:14.829252 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e96141b0-319f-4f98-a6da-f5e59ff70339 None None] The sync data for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi is: [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:34Z', 'revision_number': 4, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi', '_interfaces': [{'id': 'aabb4c34-a04c-4c90-8b7d-94b550c74426', 'name': '', 'network_id': '245ba82b-ada3-409a-912d-4462e3cd3ab8', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'mac_address': 'fa:16:3e:c6:db:c2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_interface', 'standard_attr_id': 657, 'fixed_ips': [{'subnet_id': '548e3893-a447-4905-aa48-fd4e75373585', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:34Z', 'updated_at': '2021-12-09T14:50:38Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'subnets': [{'id': '548e3893-a447-4905-aa48-fd4e75373585', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:57:14.937762 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:15.050655 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a94daa63-c981-436c-afb4-283f384c85eb None None] New status for floating IP 503721b7-6546-41f1-a3cc-46b507f13a1e: DOWN {{(pid=109064) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Dec 09 14:57:15.654794 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-495c214a-39bf-421f-910b-a59825c35cd8 req-cb237893-479f-48f1-a357-9e789ef6685b tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109062) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:57:15.656272 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-495c214a-39bf-421f-910b-a59825c35cd8 req-cb237893-479f-48f1-a357-9e789ef6685b tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 946 time: 0.0562308 Dec 09 14:57:15.707852 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-495c214a-39bf-421f-910b-a59825c35cd8 req-f1425f3f-eb57-430d-bc42-081bbe7a07c4 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/security-groups?id=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426192 Dec 09 14:57:15.870825 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d891cd8-c34c-4194-9ec0-4005041bc70f req-bb4fe471-3646-463b-b6b5-8b255921994d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=109061) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Dec 09 14:57:15.872270 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3d891cd8-c34c-4194-9ec0-4005041bc70f req-bb4fe471-3646-463b-b6b5-8b255921994d tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.44 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 946 time: 0.0606730 Dec 09 14:57:15.960744 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-3d891cd8-c34c-4194-9ec0-4005041bc70f req-25f5a3af-756f-46d4-9ef2-3143895fcfaf tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Deleting port 65be3d81-a35f-4fa9-a69a-59deb88c6a80 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:57:15.961064 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-3d891cd8-c34c-4194-9ec0-4005041bc70f req-25f5a3af-756f-46d4-9ef2-3143895fcfaf tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:16.061167 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [req-3d891cd8-c34c-4194-9ec0-4005041bc70f req-25f5a3af-756f-46d4-9ef2-3143895fcfaf tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] For port 65be3d81-a35f-4fa9-a69a-59deb88c6a80, host hv-cinder-81969, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81969',level=0,port_id=65be3d81-a35f-4fa9-a69a-59deb88c6a80,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:57:16.061528 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-3d891cd8-c34c-4194-9ec0-4005041bc70f req-25f5a3af-756f-46d4-9ef2-3143895fcfaf tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:16.074551 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [req-3d891cd8-c34c-4194-9ec0-4005041bc70f req-25f5a3af-756f-46d4-9ef2-3143895fcfaf tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Calling delete_port for 65be3d81-a35f-4fa9-a69a-59deb88c6a80 owned by compute:nova {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:57:16.212570 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-3d891cd8-c34c-4194-9ec0-4005041bc70f req-25f5a3af-756f-46d4-9ef2-3143895fcfaf tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:16.240491 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25f5a3af-756f-46d4-9ef2-3143895fcfaf tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event deleted for resources: {'Port': ['ID=65be3d81-a35f-4fa9-a69a-59deb88c6a80,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:16.282655 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.l3_dvrscheduler_db [req-3d891cd8-c34c-4194-9ec0-4005041bc70f req-25f5a3af-756f-46d4-9ef2-3143895fcfaf tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] No DVR routers for this DVR port 65be3d81-a35f-4fa9-a69a-59deb88c6a80 on host hv-cinder-81969 {{(pid=109061) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:57:16.285414 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [req-3d891cd8-c34c-4194-9ec0-4005041bc70f req-25f5a3af-756f-46d4-9ef2-3143895fcfaf tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for port, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:16.288802 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [req-3d891cd8-c34c-4194-9ec0-4005041bc70f req-25f5a3af-756f-46d4-9ef2-3143895fcfaf tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.44 "DELETE /v2.0/ports/65be3d81-a35f-4fa9-a69a-59deb88c6a80 HTTP/1.1" status: 204 len: 173 time: 0.4103491 Dec 09 14:57:16.289255 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '81780f80-b704-4238-a626-320bce1e01af', 'name': 'network-vif-deleted', 'tag': '65be3d81-a35f-4fa9-a69a-59deb88c6a80'}] {{(pid=109061) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Dec 09 14:57:16.291966 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.39/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}c45d804a76fcddccf6d8f256238ffdab6c866c88bc08e985d29317a7494f13f1" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2fcc7922-47c7-4a3f-a5d4-b5cbc9860d45" -d '{"events": [{"server_uuid": "81780f80-b704-4238-a626-320bce1e01af", "name": "network-vif-deleted", "tag": "65be3d81-a35f-4fa9-a69a-59deb88c6a80"}]}' {{(pid=109061) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Dec 09 14:57:16.330844 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 09 Dec 2021 14:57:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95dc4b21-b0f1-48ca-92b4-47a7579bbd75 x-openstack-request-id: req-95dc4b21-b0f1-48ca-92b4-47a7579bbd75 {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Dec 09 14:57:16.331168 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "81780f80-b704-4238-a626-320bce1e01af", "name": "network-vif-deleted", "tag": "65be3d81-a35f-4fa9-a69a-59deb88c6a80", "status": "completed", "code": 200}]} {{(pid=109061) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Dec 09 14:57:16.331481 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.39/compute/v2.1/os-server-external-events used request id req-95dc4b21-b0f1-48ca-92b4-47a7579bbd75 {{(pid=109061) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Dec 09 14:57:16.331921 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '81780f80-b704-4238-a626-320bce1e01af', 'name': 'network-vif-deleted', 'tag': '65be3d81-a35f-4fa9-a69a-59deb88c6a80', 'status': 'completed', 'code': 200} Dec 09 14:57:16.820270 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [req-e13b8485-0a0c-48de-9c9d-a3f6259b4ce5 req-6c18b56c-2f37-422c-b6b0-2347281e64ea tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "GET /v2.0/ports?device_id=81780f80-b704-4238-a626-320bce1e01af HTTP/1.1" status: 200 len: 210 time: 0.0274744 Dec 09 14:57:17.882924 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34774) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:18.004763 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-64ec3f1d-81cd-435c-a64f-1d14ea7e0d6e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Deleting port 1ec1fe55-e757-4bd0-accd-687d5d785bef {{(pid=109062) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:57:18.004989 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-64ec3f1d-81cd-435c-a64f-1d14ea7e0d6e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:18.082541 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-64ec3f1d-81cd-435c-a64f-1d14ea7e0d6e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:18.082919 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-64ec3f1d-81cd-435c-a64f-1d14ea7e0d6e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:18.101322 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-64ec3f1d-81cd-435c-a64f-1d14ea7e0d6e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Calling delete_port for 1ec1fe55-e757-4bd0-accd-687d5d785bef owned by network:floatingip {{(pid=109062) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:57:18.232035 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-64ec3f1d-81cd-435c-a64f-1d14ea7e0d6e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:18.259395 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64ec3f1d-81cd-435c-a64f-1d14ea7e0d6e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event deleted for resources: {'Port': ['ID=1ec1fe55-e757-4bd0-accd-687d5d785bef,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:18.318480 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-64ec3f1d-81cd-435c-a64f-1d14ea7e0d6e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for floatingip, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:18.321261 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-64ec3f1d-81cd-435c-a64f-1d14ea7e0d6e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-28285'] for floatingip, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:18.322419 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-64ec3f1d-81cd-435c-a64f-1d14ea7e0d6e tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "DELETE /v2.0/floatingips/2ea75a48-5744-4a2d-af6a-18dad1ebd4e3 HTTP/1.1" status: 204 len: 168 time: 0.4384840 Dec 09 14:57:19.525913 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34786) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:19.588413 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-12871002-1afb-4b4d-a3c2-c201f8204d21 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:19.621606 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-12871002-1afb-4b4d-a3c2-c201f8204d21 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:19.689903 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-12871002-1afb-4b4d-a3c2-c201f8204d21 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:19.692677 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-12871002-1afb-4b4d-a3c2-c201f8204d21 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:19.693953 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-12871002-1afb-4b4d-a3c2-c201f8204d21 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] 10.222.0.39 "DELETE /v2.0/security-groups/97e4de8e-53ca-4a2a-af5b-2f037e0d4f04 HTTP/1.1" status: 204 len: 168 time: 0.1670413 Dec 09 14:57:19.702728 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12871002-1afb-4b4d-a3c2-c201f8204d21 tempest-TestVolumeBootPattern-1712368094 tempest-TestVolumeBootPattern-1712368094-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=97e4de8e-53ca-4a2a-af5b-2f037e0d4f04,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:19.747427 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 34790) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:20.257457 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ccf4b138-99e4-4524-a877-0f83014ae78f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1629277'] for router_interface, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:20.515873 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-ccf4b138-99e4-4524-a877-0f83014ae78f admin admin] Deleting port aabb4c34-a04c-4c90-8b7d-94b550c74426 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:57:20.516121 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ccf4b138-99e4-4524-a877-0f83014ae78f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:20.590546 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-ccf4b138-99e4-4524-a877-0f83014ae78f admin admin] For port aabb4c34-a04c-4c90-8b7d-94b550c74426, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=aabb4c34-a04c-4c90-8b7d-94b550c74426,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:57:20.590913 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ccf4b138-99e4-4524-a877-0f83014ae78f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:20.603414 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-ccf4b138-99e4-4524-a877-0f83014ae78f admin admin] Calling delete_port for aabb4c34-a04c-4c90-8b7d-94b550c74426 owned by network:router_interface {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:57:20.783752 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ccf4b138-99e4-4524-a877-0f83014ae78f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:21.070912 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccf4b138-99e4-4524-a877-0f83014ae78f admin admin] Pushing event deleted for resources: {'Port': ['ID=aabb4c34-a04c-4c90-8b7d-94b550c74426,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:21.237378 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-ccf4b138-99e4-4524-a877-0f83014ae78f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2066028', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1629233'] for router_interface, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:21.374190 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 65be3d81-a35f-4fa9-a69a-59deb88c6a80 no longer exists at agent hyperv_hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:57:21.394284 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] No Port match for: 65be3d81-a35f-4fa9-a69a-59deb88c6a80 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:57:21.394610 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Device 65be3d81-a35f-4fa9-a69a-59deb88c6a80 not bound to the agent host hv-cinder-81969 {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:57:21.470735 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ccf4b138-99e4-4524-a877-0f83014ae78f admin admin] Router 0afa8c36-934f-4ee2-8457-fb4e00214c4d has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:57:21.586429 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ccf4b138-99e4-4524-a877-0f83014ae78f admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:57:21.592203 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-ccf4b138-99e4-4524-a877-0f83014ae78f admin admin] 10.222.0.39 "PUT /v2.0/routers/0afa8c36-934f-4ee2-8457-fb4e00214c4d/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8435848 Dec 09 14:57:21.595455 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 34794) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:21.598198 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7562129f-3448-4a93-93d0-16bf64a027f0 None None] Sync routers for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:57:21.609104 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7562129f-3448-4a93-93d0-16bf64a027f0 None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:57:21.609761 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-7562129f-3448-4a93-93d0-16bf64a027f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:56:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:21.699762 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] Publish callbacks [] for router, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:21.713272 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-7562129f-3448-4a93-93d0-16bf64a027f0 None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: dv-cinder-819692-8-iscsi {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:57:21.801575 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:21.852714 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] Deleting port 22aa78c6-5086-49e6-90b2-f0ea5ec6044f {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:57:21.853055 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:21.886479 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-7562129f-3448-4a93-93d0-16bf64a027f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209'}], 'enable_snat': True}, 'gw_port_id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:57:20Z', 'revision_number': 5, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port': {'id': '22aa78c6-5086-49e6-90b2-f0ea5ec6044f', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:17:a5:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'device_owner': 'network:router_gateway', 'standard_attr_id': 646, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.209', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:50:37Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:21.916240 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7562129f-3448-4a93-93d0-16bf64a027f0 None None] Checking router: 0afa8c36-934f-4ee2-8457-fb4e00214c4d for host: dv-cinder-819692-8-iscsi {{(pid=109063) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:57:21.924861 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7562129f-3448-4a93-93d0-16bf64a027f0 None None] Routers {'0afa8c36-934f-4ee2-8457-fb4e00214c4d'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109063) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:57:21.925464 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-7562129f-3448-4a93-93d0-16bf64a027f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:56:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'], 'active': True} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:21.931921 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] For port 22aa78c6-5086-49e6-90b2-f0ea5ec6044f, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=22aa78c6-5086-49e6-90b2-f0ea5ec6044f,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:57:21.932293 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:21.945602 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] Calling delete_port for 22aa78c6-5086-49e6-90b2-f0ea5ec6044f owned by network:router_gateway {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:57:22.008071 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_dvr_db [None req-7562129f-3448-4a93-93d0-16bf64a027f0 None None] Set router 0afa8c36-934f-4ee2-8457-fb4e00214c4d gateway port host: None {{(pid=109063) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:57:22.057448 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.db.l3_hamode_db [None req-7562129f-3448-4a93-93d0-16bf64a027f0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:57:21Z', 'revision_number': 6, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port_host': None}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109063) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:22.086488 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7562129f-3448-4a93-93d0-16bf64a027f0 None None] The sync data for ids ['0afa8c36-934f-4ee2-8457-fb4e00214c4d'] in dv-cinder-819692-8-iscsi is: [{'id': '0afa8c36-934f-4ee2-8457-fb4e00214c4d', 'name': 'tempest-TestVolumeBootPattern-1920504822-router', 'tenant_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:31Z', 'updated_at': '2021-12-09T14:57:21Z', 'revision_number': 6, 'project_id': '9e02a1db560b45ddbee50b9e57d1f4f0', 'gw_port_host': None}] {{(pid=109063) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:57:22.114682 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:22.145216 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] Pushing event deleted for resources: {'Port': ['ID=22aa78c6-5086-49e6-90b2-f0ea5ec6044f,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:22.213741 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1574291'] for router_gateway, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:22.303101 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1626627', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30560'] for router, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:22.305249 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:22.350346 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1626682'] for router, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:22.350973 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 0afa8c36-934f-4ee2-8457-fb4e00214c4d {{(pid=109061) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 14:57:22.357300 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:22.358861 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-2e4b6f0f-4699-4fcb-9bd5-b5d704b4bd2f admin admin] 10.222.0.39 "DELETE /v2.0/routers/0afa8c36-934f-4ee2-8457-fb4e00214c4d HTTP/1.1" status: 204 len: 168 time: 0.7624347 Dec 09 14:57:22.362035 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34796) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:22.412000 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.db_base_plugin_v2 [None req-a03c3c2d-bc22-45a5-b99e-ec25add45fe2 admin admin] Deleting subnet 548e3893-a447-4905-aa48-fd4e75373585 {{(pid=109062) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:57:22.415056 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a03c3c2d-bc22-45a5-b99e-ec25add45fe2 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:22.450298 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a03c3c2d-bc22-45a5-b99e-ec25add45fe2 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-130415749'] for subnet, precommit_delete_associations {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:22.531368 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a03c3c2d-bc22-45a5-b99e-ec25add45fe2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:22.586249 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a03c3c2d-bc22-45a5-b99e-ec25add45fe2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-130461228', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-130768914'] for subnet, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:22.609276 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a03c3c2d-bc22-45a5-b99e-ec25add45fe2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=548e3893-a447-4905-aa48-fd4e75373585,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:22.616280 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-a03c3c2d-bc22-45a5-b99e-ec25add45fe2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for subnet, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:22.621003 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-a03c3c2d-bc22-45a5-b99e-ec25add45fe2 admin admin] 10.222.0.39 "DELETE /v2.0/subnets/548e3893-a447-4905-aa48-fd4e75373585 HTTP/1.1" status: 204 len: 168 time: 0.2577195 Dec 09 14:57:22.621917 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-26d01834-b4d7-4d87-b6ff-6a2f1e7dfc4a None None] Network 245ba82b-ada3-409a-912d-4462e3cd3ab8 requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:57:22.623559 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34798) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:22.693210 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:22.748396 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] Deleting port 00b2689f-768f-4c56-a413-94826006dbf9 {{(pid=109062) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:57:22.748703 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:22.818169 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.db [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] For port 00b2689f-768f-4c56-a413-94826006dbf9, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=00b2689f-768f-4c56-a413-94826006dbf9,segment=NetworkSegment(a705bcc4-c3b3-42a8-bec6-657a4661427a),segment_id=a705bcc4-c3b3-42a8-bec6-657a4661427a)] {{(pid=109062) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:57:22.818626 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:22.833837 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] Calling delete_port for 00b2689f-768f-4c56-a413-94826006dbf9 owned by network:dhcp {{(pid=109062) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:57:22.918323 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bf865d5-1a94-466e-a3af-6a068cd1c637 None None] DHCP port deletion for 245ba82b-ada3-409a-912d-4462e3cd3ab8 request from dv-cinder-819692-8-iscsi {{(pid=109063) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 14:57:22.923555 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:22.956536 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] No DVR routers for this DVR port 00b2689f-768f-4c56-a413-94826006dbf9 on host dv-cinder-819692-8-iscsi {{(pid=109062) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:57:22.960330 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] Pushing event deleted for resources: {'Port': ['ID=00b2689f-768f-4c56-a413-94826006dbf9,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:23.026538 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:23.049711 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['245ba82b-ada3-409a-912d-4462e3cd3ab8']}} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:23.059635 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a705bcc4-c3b3-42a8-bec6-657a4661427a') {'for_net_delete': True} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:23.059958 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a705bcc4-c3b3-42a8-bec6-657a4661427a') {} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:23.070291 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-130415758'] for segment, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:23.089732 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:23.097747 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] Releasing vlan 400 on physical network physnet1 to pool {{(pid=109062) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:57:23.098213 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-130461398'] for segment, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: Traceback (most recent call last): Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: timer() Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: cb(*args, **kw) Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: return func(*args, **kwargs) Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: self._notify() Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: self.callback(batched_events) Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: event.method(event) Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: return f(self, *a, **k) Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._get(url).json() Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: return self.request(url, 'GET', **kwargs) Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:57:23.100080 dv-cinder-819692-8-iscsi neutron-server[109062]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:57:23.159451 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:23.164894 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:23.168220 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] 10.222.0.39 "DELETE /v2.0/networks/245ba82b-ada3-409a-912d-4462e3cd3ab8 HTTP/1.1" status: 204 len: 168 time: 0.5436764 Dec 09 14:57:23.171464 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 34800) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:23.178834 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-658cc9c5-5ab2-4c72-8257-ff749a4ddd7c admin admin] Pushing event deleted for resources: {'Network': ['ID=245ba82b-ada3-409a-912d-4462e3cd3ab8,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:23.527117 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 22aa78c6-5086-49e6-90b2-f0ea5ec6044f no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:57:23.532295 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2ef620cf-d62c-43c7-be56-77692f38ea6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1629277'] for router_interface, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:23.547426 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 22aa78c6-5086-49e6-90b2-f0ea5ec6044f {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:57:23.547892 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 22aa78c6-5086-49e6-90b2-f0ea5ec6044f not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:57:23.548374 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 00b2689f-768f-4c56-a413-94826006dbf9 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:57:23.566950 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 00b2689f-768f-4c56-a413-94826006dbf9 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:57:23.567297 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 00b2689f-768f-4c56-a413-94826006dbf9 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:57:23.567740 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device aabb4c34-a04c-4c90-8b7d-94b550c74426 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:57:23.586244 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: aabb4c34-a04c-4c90-8b7d-94b550c74426 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:57:23.586622 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device aabb4c34-a04c-4c90-8b7d-94b550c74426 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:57:23.774927 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-2ef620cf-d62c-43c7-be56-77692f38ea6c admin admin] Deleting port 487f04d3-d67c-4d95-9907-091d5edafbc8 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:57:23.775269 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2ef620cf-d62c-43c7-be56-77692f38ea6c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:23.855029 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-2ef620cf-d62c-43c7-be56-77692f38ea6c admin admin] For port 487f04d3-d67c-4d95-9907-091d5edafbc8, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=487f04d3-d67c-4d95-9907-091d5edafbc8,segment=NetworkSegment(339d7547-a985-4aa6-9bcd-8bde772cd987),segment_id=339d7547-a985-4aa6-9bcd-8bde772cd987)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:57:23.855381 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2ef620cf-d62c-43c7-be56-77692f38ea6c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:23.868091 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-2ef620cf-d62c-43c7-be56-77692f38ea6c admin admin] Calling delete_port for 487f04d3-d67c-4d95-9907-091d5edafbc8 owned by network:router_interface {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:57:24.052843 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2ef620cf-d62c-43c7-be56-77692f38ea6c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:24.082684 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ef620cf-d62c-43c7-be56-77692f38ea6c admin admin] Pushing event deleted for resources: {'Port': ['ID=487f04d3-d67c-4d95-9907-091d5edafbc8,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:24.242180 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-2ef620cf-d62c-43c7-be56-77692f38ea6c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-2066028', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1629233'] for router_interface, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:24.459784 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2ef620cf-d62c-43c7-be56-77692f38ea6c admin admin] Router d3213dfc-948c-48f6-a78a-7e1a0a5721d5 has already been hosted by L3 agent d9048829-2654-4d94-83cc-155a0884505e {{(pid=109061) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Dec 09 14:57:24.567393 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2ef620cf-d62c-43c7-be56-77692f38ea6c admin admin] Notify agent at l3_agent.dv-cinder-819692-8-iscsi the message routers_updated {{(pid=109061) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Dec 09 14:57:24.572740 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-2ef620cf-d62c-43c7-be56-77692f38ea6c admin admin] 10.222.0.39 "PUT /v2.0/routers/d3213dfc-948c-48f6-a78a-7e1a0a5721d5/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4001780 Dec 09 14:57:24.576132 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 34802) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:24.576668 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30c1d886-6ba1-416d-b598-07ad4a789f62 None None] Sync routers for ids ['d3213dfc-948c-48f6-a78a-7e1a0a5721d5'] in dv-cinder-819692-8-iscsi {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Dec 09 14:57:24.586788 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30c1d886-6ba1-416d-b598-07ad4a789f62 None None] Routers {'d3213dfc-948c-48f6-a78a-7e1a0a5721d5'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:57:24.587404 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-30c1d886-6ba1-416d-b598-07ad4a789f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:56:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['d3213dfc-948c-48f6-a78a-7e1a0a5721d5'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:24.691002 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-30c1d886-6ba1-416d-b598-07ad4a789f62 None None] Set router d3213dfc-948c-48f6-a78a-7e1a0a5721d5 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:57:24.945766 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] Publish callbacks [] for router, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:24.965024 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-30c1d886-6ba1-416d-b598-07ad4a789f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'name': 'tempest-TestVolumeBootPattern-587319122-router', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:36Z', 'updated_at': '2021-12-09T14:57:23Z', 'revision_number': 5, 'project_id': '065be8eed6174ffd941b9a5500ba878c', 'gw_port': {'id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:cb:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:37Z', 'updated_at': '2021-12-09T14:50:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:24.990158 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30c1d886-6ba1-416d-b598-07ad4a789f62 None None] Checking router: d3213dfc-948c-48f6-a78a-7e1a0a5721d5 for host: dv-cinder-819692-8-iscsi {{(pid=109064) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Dec 09 14:57:24.999227 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvrscheduler_db [None req-30c1d886-6ba1-416d-b598-07ad4a789f62 None None] Routers {'d3213dfc-948c-48f6-a78a-7e1a0a5721d5'} bound to L3 agent in host dv-cinder-819692-8-iscsi {{(pid=109064) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Dec 09 14:57:24.999947 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-30c1d886-6ba1-416d-b598-07ad4a789f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-819692-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-12-09T14:34:59Z,description=,heartbeat_timestamp=2021-12-09T14:56:59Z,host='dv-cinder-819692-8-iscsi',id=d9048829-2654-4d94-83cc-155a0884505e,load=0,resource_versions=,resources_synced=,started_at=2021-12-09T14:34:59Z,topic='l3_agent')) {'router_ids': ['d3213dfc-948c-48f6-a78a-7e1a0a5721d5'], 'active': True} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:25.042759 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:25.100326 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] Deleting port 7ca0ba75-484d-4138-b03a-ffa267941846 {{(pid=109061) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:57:25.100676 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:25.101870 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_dvr_db [None req-30c1d886-6ba1-416d-b598-07ad4a789f62 None None] Set router d3213dfc-948c-48f6-a78a-7e1a0a5721d5 gateway port host: dv-cinder-819692-8-iscsi {{(pid=109064) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Dec 09 14:57:25.177711 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.db [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] For port 7ca0ba75-484d-4138-b03a-ffa267941846, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=7ca0ba75-484d-4138-b03a-ffa267941846,segment=NetworkSegment(f0f2cb71-999b-4f79-9acb-b9cd907fc3ab),segment_id=f0f2cb71-999b-4f79-9acb-b9cd907fc3ab)] {{(pid=109061) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:57:25.178082 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:25.190549 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.plugins.ml2.plugin [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] Calling delete_port for 7ca0ba75-484d-4138-b03a-ffa267941846 owned by network:router_gateway {{(pid=109061) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:57:25.279454 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.l3_hamode_db [None req-30c1d886-6ba1-416d-b598-07ad4a789f62 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'name': 'tempest-TestVolumeBootPattern-587319122-router', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:36Z', 'updated_at': '2021-12-09T14:57:23Z', 'revision_number': 5, 'project_id': '065be8eed6174ffd941b9a5500ba878c', 'gw_port': {'id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:cb:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:37Z', 'updated_at': '2021-12-09T14:50:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}], 'dv-cinder-819692-8-iscsi', False) {} {{(pid=109064) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:25.308277 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-30c1d886-6ba1-416d-b598-07ad4a789f62 None None] The sync data for ids ['d3213dfc-948c-48f6-a78a-7e1a0a5721d5'] in dv-cinder-819692-8-iscsi is: [{'id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'name': 'tempest-TestVolumeBootPattern-587319122-router', 'tenant_id': '065be8eed6174ffd941b9a5500ba878c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'external_fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11'}], 'enable_snat': True}, 'gw_port_id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-12-09T14:50:36Z', 'updated_at': '2021-12-09T14:57:23Z', 'revision_number': 5, 'project_id': '065be8eed6174ffd941b9a5500ba878c', 'gw_port': {'id': '7ca0ba75-484d-4138-b03a-ffa267941846', 'name': '', 'network_id': 'ff53a7f4-1c86-4ad4-9713-d217dd3cbd6c', 'tenant_id': '', 'mac_address': 'fa:16:3e:f5:cb:d6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd3213dfc-948c-48f6-a78a-7e1a0a5721d5', 'device_owner': 'network:router_gateway', 'standard_attr_id': 676, 'fixed_ips': [{'subnet_id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'ip_address': '172.27.0.11', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-819692-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-12-09T14:50:37Z', 'updated_at': '2021-12-09T14:50:43Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': 'e694bbf8-2176-4a1d-9b13-4712a7fb8309', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-819692-8-iscsi'}] {{(pid=109064) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Dec 09 14:57:25.367537 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-133412108'] for port, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:25.393073 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] Pushing event deleted for resources: {'Port': ['ID=7ca0ba75-484d-4138-b03a-ffa267941846,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:25.454816 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1574291'] for router_gateway, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:25.543930 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1626627', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-30560'] for router, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:25.546041 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:25.589685 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1626682'] for router, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:25.590307 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] Fanout notify agent at l3_agent the message router_deleted on router d3213dfc-948c-48f6-a78a-7e1a0a5721d5 {{(pid=109061) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Dec 09 14:57:25.595075 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] Publish callbacks [] for router, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:25.596208 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-7b320506-bb91-48cc-80ec-7d9563864ee0 admin admin] 10.222.0.39 "DELETE /v2.0/routers/d3213dfc-948c-48f6-a78a-7e1a0a5721d5 HTTP/1.1" status: 204 len: 168 time: 1.0192041 Dec 09 14:57:25.599768 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 34804) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:25.652301 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.db.db_base_plugin_v2 [None req-0edd8cc3-fdbc-47cc-8868-921c2b992bb9 admin admin] Deleting subnet b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7 {{(pid=109061) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Dec 09 14:57:25.655941 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-0edd8cc3-fdbc-47cc-8868-921c2b992bb9 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:25.696156 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-0edd8cc3-fdbc-47cc-8868-921c2b992bb9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-1271942'] for subnet, precommit_delete_associations {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:25.749576 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 487f04d3-d67c-4d95-9907-091d5edafbc8 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:57:25.774023 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 487f04d3-d67c-4d95-9907-091d5edafbc8 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:57:25.774367 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 487f04d3-d67c-4d95-9907-091d5edafbc8 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:57:25.777396 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-0edd8cc3-fdbc-47cc-8868-921c2b992bb9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-920890'] for subnet, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:25.833410 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-0edd8cc3-fdbc-47cc-8868-921c2b992bb9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-921025', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1661524', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-133412315', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-133640812'] for subnet, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:25.862518 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0edd8cc3-fdbc-47cc-8868-921c2b992bb9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:25.866584 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-0edd8cc3-fdbc-47cc-8868-921c2b992bb9 admin admin] Publish callbacks [] for subnet, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:25.870165 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-0edd8cc3-fdbc-47cc-8868-921c2b992bb9 admin admin] 10.222.0.39 "DELETE /v2.0/subnets/b447a2e3-7b39-4df8-b2dd-1b71ebff7dd7 HTTP/1.1" status: 204 len: 168 time: 0.2694619 Dec 09 14:57:25.873047 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34806) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:25.876748 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c7b47ba-a33b-41de-8e2a-eba1341c22c3 None None] Network ea889acf-d9a7-46d5-8f93-62ab83c7501b requested from dv-cinder-819692-8-iscsi {{(pid=109063) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:219}} Dec 09 14:57:25.942226 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-988011'] for network, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:26.007812 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] Deleting port d2c041c6-719a-435f-8051-f823b16ff2d8 {{(pid=109062) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Dec 09 14:57:26.008157 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8747843035064'] for port, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:26.069687 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.db [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] For port d2c041c6-719a-435f-8051-f823b16ff2d8, host dv-cinder-819692-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-819692-8-iscsi',level=0,port_id=d2c041c6-719a-435f-8051-f823b16ff2d8,segment=NetworkSegment(339d7547-a985-4aa6-9bcd-8bde772cd987),segment_id=339d7547-a985-4aa6-9bcd-8bde772cd987)] {{(pid=109062) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Dec 09 14:57:26.070043 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1581806'] for port, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:26.082780 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.plugin [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] Calling delete_port for d2c041c6-719a-435f-8051-f823b16ff2d8 owned by network:dhcp {{(pid=109062) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Dec 09 14:57:26.172097 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-914746', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-64029', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8747843042079', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8747842492959', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-130461435'] for port, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:26.196402 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] Pushing event deleted for resources: {'Port': ['ID=d2c041c6-719a-435f-8051-f823b16ff2d8,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:26.200982 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] No DVR routers for this DVR port d2c041c6-719a-435f-8051-f823b16ff2d8 on host dv-cinder-819692-8-iscsi {{(pid=109062) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Dec 09 14:57:26.267821 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-924077', 'neutron.services.segments.db._delete_segments_for_network-8747843008714'] for network, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:26.286971 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ea889acf-d9a7-46d5-8f93-62ab83c7501b']}} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:26.295929 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '339d7547-a985-4aa6-9bcd-8bde772cd987') {'for_net_delete': True} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:26.296175 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.services.segments.db [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '339d7547-a985-4aa6-9bcd-8bde772cd987') {} {{(pid=109062) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Dec 09 14:57:26.309728 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8747842964691', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-130415758'] for segment, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:26.323278 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111'] for segment, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:26.330731 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] Releasing vlan 411 on physical network physnet1 to pool {{(pid=109062) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Dec 09 14:57:26.331276 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-919111', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-130461398'] for segment, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:26.333219 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7be8fcbf-c4bd-4473-9558-255607486fed None None] DHCP port deletion for ea889acf-d9a7-46d5-8f93-62ab83c7501b request from dv-cinder-819692-8-iscsi {{(pid=109063) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:277}} Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: Traceback (most recent call last): Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: timer() Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: cb(*args, **kw) Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: return func(*args, **kwargs) Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: self._notify() Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: self.callback(batched_events) Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: event.method(event) Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_id = self._get_aggregate_id(event.segment_id) Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: aggregate_uuid = self.p_client.list_aggregates( Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: return f(self, *a, **k) Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._get(url).json() Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: return self._client.get(url, endpoint_filter=self._ks_filter, Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: return self.request(url, 'GET', **kwargs) Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: base_url = self.get_endpoint(auth, allow=allow, Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: auth = self._auth_required(auth, 'determine endpoint URL') Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Dec 09 14:57:26.333456 dv-cinder-819692-8-iscsi neutron-server[109062]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Dec 09 14:57:26.392563 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-924084', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647805', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-2066021', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1574319'] for network, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:26.397748 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-2065931'] for network, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:26.400835 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] 10.222.0.39 "DELETE /v2.0/networks/ea889acf-d9a7-46d5-8f93-62ab83c7501b HTTP/1.1" status: 204 len: 168 time: 0.5268555 Dec 09 14:57:26.411579 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e33769d6-923e-4978-bb43-42013b5bdf2e admin admin] Pushing event deleted for resources: {'Network': ['ID=ea889acf-d9a7-46d5-8f93-62ab83c7501b,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:26.519064 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34810) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:26.559072 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-3efa9171-ffb2-40ab-9734-49fc41f8edda admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=9e02a1db560b45ddbee50b9e57d1f4f0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0386357 Dec 09 14:57:26.561667 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [-] (109062) accepted ('10.222.0.39', 34812) {{(pid=109062) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:26.616982 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-05060e06-738a-4424-a017-437046fb2629 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:26.640499 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-05060e06-738a-4424-a017-437046fb2629 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:26.703720 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-05060e06-738a-4424-a017-437046fb2629 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:26.703720 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron_lib.callbacks.manager [None req-05060e06-738a-4424-a017-437046fb2629 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109062) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:26.703720 dv-cinder-819692-8-iscsi neutron-server[109062]: INFO neutron.wsgi [None req-05060e06-738a-4424-a017-437046fb2629 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/84c335f5-1b09-4d7b-a97c-3ce21937ac9f HTTP/1.1" status: 204 len: 168 time: 0.1396501 Dec 09 14:57:26.710370 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05060e06-738a-4424-a017-437046fb2629 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=84c335f5-1b09-4d7b-a97c-3ce21937ac9f,revision_number=None']} {{(pid=109062) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:27.031938 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 34818) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:27.047704 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-999ced86-f1de-4b14-8d1c-226ce30856ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:27.073408 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-7475258e-58a2-44e1-9da2-49cda815ad74 admin admin] 10.222.0.39 "GET /v2.0/security-groups?tenant_id=065be8eed6174ffd941b9a5500ba878c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0402627 Dec 09 14:57:27.075943 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [-] (109061) accepted ('10.222.0.39', 34820) {{(pid=109061) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Dec 09 14:57:27.122416 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4f44da86-ad93-4694-bcd2-1b9b56baccf5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:27.143203 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4f44da86-ad93-4694-bcd2-1b9b56baccf5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:27.200243 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4f44da86-ad93-4694-bcd2-1b9b56baccf5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-1647726'] for security_group, after_delete {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:27.202953 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron_lib.callbacks.manager [None req-4f44da86-ad93-4694-bcd2-1b9b56baccf5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=109061) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:27.204137 dv-cinder-819692-8-iscsi neutron-server[109061]: INFO neutron.wsgi [None req-4f44da86-ad93-4694-bcd2-1b9b56baccf5 admin admin] 10.222.0.39 "DELETE /v2.0/security-groups/097edbc9-63e0-45a5-8191-cd28804e2b43 HTTP/1.1" status: 204 len: 168 time: 0.1272969 Dec 09 14:57:27.211958 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f44da86-ad93-4694-bcd2-1b9b56baccf5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=097edbc9-63e0-45a5-8191-cd28804e2b43,revision_number=None']} {{(pid=109061) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Dec 09 14:57:27.527568 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device d2c041c6-719a-435f-8051-f823b16ff2d8 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:57:27.549552 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: d2c041c6-719a-435f-8051-f823b16ff2d8 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:57:27.549773 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device d2c041c6-719a-435f-8051-f823b16ff2d8 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:57:27.550186 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 7ca0ba75-484d-4138-b03a-ffa267941846 no longer exists at agent ovs-agent-dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Dec 09 14:57:27.570382 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.plugin [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] No Port match for: 7ca0ba75-484d-4138-b03a-ffa267941846 {{(pid=109063) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Dec 09 14:57:27.570729 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron.plugins.ml2.rpc [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Device 7ca0ba75-484d-4138-b03a-ffa267941846 not bound to the agent host dv-cinder-819692-8-iscsi {{(pid=109063) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Dec 09 14:57:29.185001 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-aa777509-7944-4b4a-b6fa-e5ddc18eb705 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:30.499214 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:31.880726 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:32.612479 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:37.494628 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:57:44.937942 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:57.064186 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-07f19165-2dc8-4305-b5ca-f5881f99d3df None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:57:59.188025 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-0b4c8cbc-46b1-44f2-a73f-4843033e0905 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:58:00.504646 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:58:01.877614 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:58:02.621005 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:58:08.162742 dv-cinder-819692-8-iscsi neutron-server[109062]: DEBUG neutron.wsgi [req-0b387fa9-c0bf-430c-b26d-af3c88306a03 req-b7b3f086-fc18-49e4-9632-accf1aeabaad service neutron] (109062) timed out ('10.222.0.44', 63426) {{(pid=109062) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 14:58:12.462348 dv-cinder-819692-8-iscsi neutron-server[109061]: DEBUG neutron.wsgi [req-1deebd0f-7c4d-4776-abd7-280d2e703830 req-8b8ae962-381b-43cb-9e5f-6c0fde901c0a service neutron] (109061) timed out ('10.222.0.44', 63448) {{(pid=109061) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Dec 09 14:58:14.499413 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:58:14.946385 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:58:27.056267 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-951215d3-29f9-4b04-81c0-62d0fc79997f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:58:29.194477 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-7977eac4-e4d7-4cc5-bce2-a44e58974d98 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:58:30.511456 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:58:31.884049 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:58:32.626193 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:58:44.950815 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:58:51.504195 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:58:57.057299 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-7929d3bc-68ef-48c9-95f0-73d13efcff65 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:58:59.187217 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-149daab4-10cd-4924-a25e-ce222ed34807 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:59:00.519180 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:59:01.889956 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:59:02.630966 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:59:14.961086 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:59:27.057235 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-775f3812-774c-407c-be97-29b346625fcc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:59:28.508688 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 14:59:29.194687 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-ba082239-a8b0-4a69-9b4e-0cdc5544e726 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:59:30.523369 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:59:31.887057 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:59:32.633148 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:59:44.966915 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:59:57.064768 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-c0caf542-37af-499e-a76b-707d0acf016c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 14:59:59.186824 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-9e70049e-890b-4065-a081-5c21aa3ae4c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:00:00.525739 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:00:01.893959 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:00:02.632812 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:00:05.514201 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 15:00:15.004953 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:00:27.061634 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-56929c12-5d2c-4839-9aef-fc7191971a21 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:00:29.191839 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-811fce71-8b06-48f2-95eb-ac87d2554f3b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:00:30.531574 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:00:31.902572 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:00:32.635353 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:00:42.520750 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 15:00:45.003455 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:00:57.059452 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-fd55d9e0-d805-4b46-9937-e433fc8ff236 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:00:59.194212 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5f9b29f2-5599-4b90-a365-d139d7e4c350 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:01:00.532100 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:01:01.901881 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:01:02.640082 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:01:15.003467 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:01:19.510471 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 15:01:27.050576 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5af5e9ce-bfad-4ae5-898b-dbbab9418a27 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:01:29.198609 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-bfb740bd-b93f-4e8b-9c41-88942e3bd766 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:01:30.540277 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:01:31.906081 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:01:32.647861 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:01:44.996114 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:01:56.514747 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Dec 09 15:01:57.053079 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-e5bcdc40-ec48-471e-b37e-541926259bff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:01:59.202582 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-dbdbdd4e-f274-4715-b231-facfc59f2376 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:02:00.543585 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:02:01.912097 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:02:02.641357 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:02:15.019001 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-5d4dfc4c-fc2f-45d5-bc59-37486b9793da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:02:27.056487 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-8017c1d4-8b96-4da6-bcf9-4b383b56619c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:02:29.207631 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-bea5f322-7b69-4cb4-820d-bc97bef4caf4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:02:30.538759 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-f7dd52f4-ced2-4f90-b4b1-5becd79fe3af None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:02:31.912799 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-22551891-10ff-4cfe-a82a-98f8c8606309 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:02:32.642566 dv-cinder-819692-8-iscsi neutron-server[109063]: DEBUG neutron_lib.callbacks.manager [None req-3422849c-779e-47d4-9c00-a47ae4d9dcfd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8747843008669', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-925435'] for agent, after_update {{(pid=109063) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Dec 09 15:02:33.513861 dv-cinder-819692-8-iscsi neutron-server[109064]: DEBUG neutron.db.agents_db [None req-67956f97-c9b6-492d-aae1-02e7e89352c4 None None] Agent healthcheck: found 6 active agents {{(pid=109064) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}